![National Spinal Cord Injury Association Mobile Logo](https://dn9tckvz2rpxv.cloudfront.net/spinalcord.jobs/img/logo.png)
Job Information
News Corp Senior Data Engineer in Bangalore, India
Job Description :
Job Description: Senior Data Engineer
About the Role
We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, DataFusion, SQL , GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with SQL, ETL and efficiently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Experience in working on distributed or cloud computing platforms such as Google Cloud is a big plus
➔ Industry knowledge on News, Media & Communications is an added advantage.
R E S P O N S I B I L I T I E S
➔ Design, implement, and maintain the scalable and reliable GCP cloud-based data infrastructure and BI - ELT processes
➔ Collaborate with cross-functional teams to define data architecture and data warehouse requirements
➔ Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
Google Cloud Platform is IaaS
BigQuery, GCS, Python, SQL
Cloud DataFusion, Composer / Airflow - orchestration tools
Terraform , CircleCI , CI/CD, GIthub, Jira, Confluence
This job is posted with NTS Technology Services Pvt. Ltd.
Job Category:
News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia.
Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom.