Job Title: Data Engineer Location: Chennai, India Experience: 4-5 years Work Mode: Full-time, In-office Department: Asign Data Sciences
About Us At Asign, we are revolutionizing the art sector with our innovative digital solutions. We are a passionate and dynamic startup dedicated to enhancing the art experience through technology. Join us in creating cutting-edge products that empower artists and art enthusiasts worldwide. Role Overview We are looking for an experienced Data Engineer with a strong grasp of ELT architecture and experience to help us build and maintain robust data pipelines. This is a hands-on role for someone passionate about structured data, automation, and scalable infrastructure. The ideal candidate will be responsible for sourcing data, ingesting, transforming, storing, and making data accessible and reliable for data analysis, machine learning, and reporting. You will play a key role in maintaining and evolving our data architecture and ensuring that our data flows efficiently and securely. Key Responsibilities * Design, develop, and maintain efficient and scalable ELT data pipelines. * Work closely with the data science and backend teams to understand data needs and transform raw inputs into structured datasets. * Integrate multiple data sources including APIs, web pages, spreadsheets, and databases into a central warehouse. * Monitor, test, and continuously improve data flows for reliability and performance. * Create documentation and establish best practices for data governance, lineage, and quality. * Collaborate with product and tech teams to plan data models that support business and AI/ML applications. Required Skills * Minimum 4 years of hands-on experience in data engineering. * Solid understanding and experience with ELT pipelines and modern data stack tools. * Practical knowledge of one or more orchestrators (Dagster, Airflow, Prefect, etc.). * Proficiency in Python and SQL. * Experience working with APIs and data integration from multiple sources. * Familiarity with one or more cloud data warehouses (e.g., Snowflake, BigQuery, Redshift). * Strong problem-solving and debugging skills. Qualifications: Technical Must-have: * B.Tech/BE with CSE/IT or ECE engineering background only * Proven experience (4 years) in data engineering, data integration, and data management * Hands-on experience in data sourcing tools and frameworks (e.g. Scrapy, Beautiful Soup, Selenium, Playwright) * Proficiency in Python and SQL for data manipulation and pipeline development * Experience with cloud-based data platforms (AWS, Azure, or GCP) and data warehouse tools (e.g. Redshift, BigQuery, Snowflake) * Familiarity with workflow orchestration tools (e.g. Airflow, Prefect, Dagster) * Strong understanding of relational and non-relational databases (PostgreSQL, MongoDB, etc.) * Solid understanding of data modeling, ETL best practices, and data governance principles * Systems knowledge and experience working with Docker. * Familiarity with version control (Git) and CI/CD processes * Strong and creative problem-solving skills and the ability to think critically about data engineering solutions. * Effective communication and collaboration skills * Ability to work independently and as part of a team in a fast-paced, dynamic environment. Technical Good-to-have: * Experience working with APIs and third-party data sources * Exposure to basic machine learning concepts and working with data science teams * Experience handling large datasets and working with distributed data systems Why Join Us? * Innovative Environment: Be part of a forward-thinking team that is dedicated to pushing the boundaries of art and technology. * Career Growth: Opportunities for professional development and career advancement. * Creative Freedom: Work in a role that values creativity and encourages new ideas. * Company Culture: Enjoy a dynamic, inclusive, and supportive work environment If you are interested, please share your resume with GitHub profile to shakthi.kan...@asign.art. With regards, SK _______________________________________________ Chennaipy mailing list -- chennaipy@python.org To unsubscribe send an email to chennaipy-le...@python.org https://mail.python.org/mailman3//lists/chennaipy.python.org Member address: arch...@mail-archive.com
