View all jobs
Sr Data Engineer (US Citizen/Migration exp from Oracle to Postgres/AWS)
Remote, Remote · Information TechnologyNorthHill Technology Resources has an immediate need for a Senior Data Engineer to support a DHS Program. This is a FULLY REMOTE, direct-hire role with our client, an award-winning Federal Integrator. Due to the nature of the work, US Citizenship is required.
Job Title: Senior Data Engineer
Location: US-Remote
Responsibilities:
As a senior data engineer, you will/may:
Qualifications:
Required Qualifications:
Clearance: US Citizen able to obtain Public Trust
Certification(s): AWS & Oracle certification is required
Job Title: Senior Data Engineer
Location: US-Remote
Responsibilities:
As a senior data engineer, you will/may:
- Design, implement, and automate deployment of our distributed system for collecting and processing data from multiple sources.
- Design data schema and operate internal data warehouses and SQL database systems.
- Own the design, development, and maintenance of ongoing metrics, reports, analyses, and dashboards that engineers, analysts, and data scientists use to drive key business decisions.
- Monitor and troubleshoot operational or data issues in the data pipelines.
- Drive architectural plans and implementation for future data storage, reporting, and analytic solutions.
- Develop code based automated data pipelines able to process millions of data points.
- Improve database and data warehouse performance by tuning inefficient queries.
- Work collaboratively with Business Analysts, Data Scientists, and other internal partners to identify opportunities/problems.
- Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of a problem.
Qualifications:
Required Qualifications:
- Expertise in Data Migration from Oracle to AWS PostgreSQL.
- Expertise in ETL
- Can articulate the basic differences between datatypes (e.g. JSON/NoSQL, relational).
- Understand the basics of designing and implementing a data schema (e.g., normalization, relational model vs dimensional model).
- 6+ yr. experience with data mining and data transformation.
- 6+ yr. experience with database and/or data warehouse
- 6+ yr. experience building data pipelines or automated ETL processes.
- 6+ yr. experience with SQL.
- 6+ yr. experience with Python, Spark (PySpark), Databricks, AWS, Azure
- 10 plus years of experince in required
- Master’s Degree or advanced technical degree
- Experience building code based on data pipelines in production able to process big datasets.
- Knowledge of writing and optimizing SQL queries with large-scale, complex datasets.
- Industry certifications including Databricks and AWS
- Experience with Spark MLlib and applying existing machine learning algorithms against data lakehouses to drive insight and predictive capabilities
- Experience with Tableau
Clearance: US Citizen able to obtain Public Trust
Certification(s): AWS & Oracle certification is required