Overview
The Data Migration Analyst will play a crucial role in leading a short-term project focused on the extraction, profiling, and migration of executed contracts into a new internal repository for a fintech software company. This position involves working with multiple, disconnected data sources to create a cleaned, reconciled, and trustworthy dataset, ensuring data quality and integrity throughout the process. The Analyst will collaborate closely with stakeholders to ensure that the migration is executed efficiently and effectively, while also documenting the entire process for future reference.
Responsibilities
- Conduct source discovery and profiling to inventory all existing data systems and assess data quality.
- Develop and execute scripts for the extraction of documents and metadata from various platforms and databases.
- Perform data cleansing and de-duplication to consolidate data into a staging dataset.
- Create and populate a metadata register to align with core fields and address any data gaps.
- Conduct validation by running sample migrations to test mapping and transformation rules.
- Execute full-scale data migration into the new repository following agreed mapping conventions.
- Document the migration process, including data lineage, anomalies, and scripts for future reference.
Requirements
- Proficient in SQL and at least one scripting language such as Python for data extraction and processing.
- Experience with data profiling, cleansing, and schema mapping from various data sources.
- Ability to reconcile structured and unstructured data into a consistent dataset.
- Detail-oriented with a strong focus on data accuracy and traceability.
- Judgment to appropriately escalate issues involving ambiguous or sensitive data.
- Experience in handling confidential data securely and professionally.