View all jobs

Sr Data Engineer (US Citizen/Migration exp from Oracle to Postgres/AWS)

Remote, Remote · Information Technology
NorthHill Technology Resources has an immediate need for a Senior Data Engineer to support a DHS Program.  This is a FULLY REMOTE, direct-hire role with our client, an award-winning Federal Integrator.  Due to the nature of the work, US Citizenship is required.

Job Title: Senior Data Engineer
Location: US-Remote
As a senior data engineer, you will/may:
  • Design, implement, and automate deployment of our distributed system for collecting and processing data from multiple sources.
  • Design data schema and operate internal data warehouses and SQL database systems.
  • Own the design, development, and maintenance of ongoing metrics, reports, analyses, and dashboards that engineers, analysts, and data scientists use to drive key business decisions.
  • Monitor and troubleshoot operational or data issues in the data pipelines.
  • Drive architectural plans and implementation for future data storage, reporting, and analytic solutions.
  • Develop code based automated data pipelines able to process millions of data points.
  • Improve database and data warehouse performance by tuning inefficient queries.
  • Work collaboratively with Business Analysts, Data Scientists, and other internal partners to identify opportunities/problems.
  • Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of a problem.
Required Qualifications:
  • Expertise in Data Migration from Oracle to AWS PostgreSQL.
  • Expertise in ETL
  • Can articulate the basic differences between datatypes (e.g. JSON/NoSQL, relational).
  • Understand the basics of designing and implementing a data schema (e.g., normalization, relational model vs dimensional model).
  • 6+ yr. experience with data mining and data transformation.
  • 6+ yr. experience with database and/or data warehouse
  • 6+ yr. experience building data pipelines or automated ETL processes.
  • 6+ yr. experience with SQL.
  • 6+ yr. experience with Python, Spark (PySpark), Databricks, AWS, Azure
  • 10 plus years of experince in required
Preferred Qualifications:
  • Master’s Degree or advanced technical degree
  • Experience building code based on data pipelines in production able to process big datasets.
  • Knowledge of writing and optimizing SQL queries with large-scale, complex datasets.
  • Industry certifications including Databricks and AWS
  • Experience with Spark MLlib and applying existing machine learning algorithms against data lakehouses to drive insight and predictive capabilities
  • Experience with Tableau
Education:  Bachelor’s degree in computer science, data analytics, business intelligence, economics, statistics, or mathematics
Clearance: US Citizen able to obtain Public Trust
Certification(s): AWS & Oracle certification is required

Powered by