SR. DATA ENGINEER

Company: ApTask
Location: Dearborn
Posted on: November 15, 2024

Job Description:

About Client:Client is a company that helps other businesses use technology to improve and grow. They provide services like creating computer programs, managing computer systems, and making sure everything is secure. Client works with different industries like telecommunications, healthcare, banking, and retail to help them use new and exciting technologies like artificial intelligence, cloud computing, and the Internet of Things. These technologies can make businesses more efficient and innovative.They have offices and people working all around the world, and their team of experts helps businesses solve their technology challenges. Client also cares about making a positive impact on society and the environment, so they support social causes and work to conserve resources.Salary Range: $100K-$115K/AnnumJob Description :We're seeking a Data Engineer who has experience building data products on a cloud analytics platform.You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP).Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics platforms on Google Cloud Platform or other cloud environments is a must.We are looking for candidates who have a broad set of technical skills across these areas.Responsibilities:Work in collaborative environment that leverages paired programmingWork on a small agile team to deliver curated data productsWork effectively with fellow data engineers, product owners, data champions and other technical expertsDemonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutionsDevelop exceptional analytical data products using both streaming and batch ingestion patterns on Google Cloud Platform with solid data warehouse principlesBe the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.Skills:Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment.Implement methods for automation of all parts of the pipeline to minimize labor in development and productionExperience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data productsExperience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumptionExperience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product managementSkills Preferred:Strong drive for results and ability to multi-task and work independentlySelf-starter with proven innovation skillsAbility to communicate and work with cross-functional teams and all levels of managementDemonstrated commitment to quality and project timingDemonstrated ability to document complex systems.Experience: 7-11 years5+ years of SQL development experience5+ years of analytics/data product development experience required3+ years of Google cloud experience with solutions designed and implemented at production scaleExperience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc.Experience migrating Teradata to GCPExperience working with Airflow for scheduling and orchestration of data pipelinesExperience working with Terraform to provision Infrastructure as Code2 + years professional development experience in Java or PythonExperience Preferred:Experience converting Microsoft SSRS, SSAS and SSIS to BQExperience converting Mainframe JCL , COBOL and CA7Experience converting SAS code to BQExperience converting Web Focus reports in to Qlik SenseIn-depth understanding of Google's product technology (or other cloud platform) and underlying architectures - Experience in working with DBT/DataformExperience with DataPlex or other data catalogs is preferredExperience with development eco-system such as Tekton, Git, Jenkins for CI/CD pipelines - Exceptional problem solving and communication skillsExperience in working with Agile and Lean methodologiesTeam player and attention to detailExperience with performance tuning SQL queries.Education: Bachelor's degree in computer science or related scientific fieldEducation Preferred:GCP Professional Data Engineer CertifiedMaster's degree in computer science or related field2+ years mentoring engineersIn-depth software engineering knowledge.About ApTask:ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment.Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.Candidate Data Collection Disclaimer:At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment.If you have any concerns or queries about your personal information, please feel free to contact our compliance team at businessexcellence@aptask.com

Keywords: ApTask, Lansing , SR. DATA ENGINEER, Engineering , Dearborn, Michigan