Community

Home >

Jobs >

Data Engineer

Karnataka, India (On-site)

Data Engineer

3 Months ago • 2 Years + • Data Analyst • Undisclosed

About the job

14 skills required for this role

Add these skills to join the top 1% applicants for this job

confluence

react

html

javascript

css

ci-cd

github

flask

python

sql

angular

terraform

google-cloud-platform

data-analytics

Job Description

Seeking a skilled Data Engineer proficient in GCP BigQuery, ETL/BL, Python, Composer/Airflow, and SQL to design, implement, and maintain scalable data infrastructure and BI processes. Experience with CI/CD and Terraform is essential. Strong analytical and problem-solving skills are a must.

Must have:

GCP BigQuery
ETL/BL, Python
Composer/Airflow
Terraform, CI/CD

Good to have:

React, Angular
Flask, Javascript
HTML, CSS
News Media

About the job

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets

Job Description :

About the Role - We are looking for a Data Engineer with experience in analytical abilities in GCP BigQuery, ETL/BL, Python, Composer / Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.

Skills & Competencies

A minimum of 2.5 years+ of working experience as a hands on data engineering is a must.

Advanced degree in the field of computer science, Data Engineering, Data Analytics or equivalent discipline.

Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL.

Prior experience with Circle CI CI/CD, Terraform and Github version control is a must.

Solid understanding of Data collection, data ingestion, data integration, and data operations & maintenance.

Experience in working with Front end technologies such as React, Angular, Flask, Javascript, HTML, CSS is a plus.

Domain knowledge on News Media and Communications is an added advantage.

Responsibilities

Design, implement and maintain the scalable and reliable GCP cloud based data infrastructure and BI - ELT processes

Collaborate with cross functional teams to define data architecture and data warehouse requirements

Automate data pipelines/ ETL / ELT processes, and data integration workflows using infrastructure as code (IaC) and configuration management tools.

Deliver production quality, modular, reproducible code in Python, SQL.

Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data related applications.

Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.

Our Tech Stack

Google Cloud Platform is laaS

BigQuery, GCS, Python, SQL

Composer / Airflow - orcestration tools

Terraform, Circle CI, CI/CD, Github, Hira, Confluence

This job is posted with NTS Technology Services Pvt. Ltd.

Job Category:

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%