Data Engineer

  • Full Time
  • Gurgaon
  • Posted 3 years ago

Responsibilities:

  • Analyze, design develop, troubleshoot, and debug Platform
  • Writes code and guides other team members for best practices and performs testing and debugging of applications.
  • As a member of the platform development division, you will perform high-level design based on provided external specifications.
  • Specify, design and implement minor changes to existing software architecture. Build highly complex enhancements and resolve complex bugs. Build and execute unit tests and unit plans.
  • Duties and tasks are varied and complex, needing independent judgment. Fully competent in my own area of expertise.

Experience:
The candidate should have about 5+ years of experience with design and development in Java/Scala. Experience in algorithms, Distributed systems, Data-structure, databases, and architectures of distributed Systems is mandatory.

Required Skills:
1. In-depth knowledge of Hadoop, Spark architecture and its components such as HDFS, YARN and executor, cores, and memory param
2. Knowledge of Scala and Java both
3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.
4. Good knowledge of Unix/Linux.
5. Experience working on large-scale software projects
6. Understanding the big picture and the various uses cases involved while crafting the solution and documenting them in Unified Modeling language.
7. Own and maintain the architecture document.
8. Keep an eye out for technological trends, open-source projects that can be used.
9. Knows common programming languages and Frameworks.
10. Real time streaming data consumption

Good to have:
1. Azure/AWS Cloud Knowledge of Data Storage and Compute side
2. Knowledge Multitenant Architecture
3. Brief idea of Data Science

Why should you Join:
A Data Science product company with startup culture, global reach and awesome peer group.

About Number Theory
Number Theory is a Machine Learning / Data Science Platform company that enables end-to-end Machine learning with integrated data ops, Model dev and MLOps accessed through one unified studio leading to accelerated data to insights journey. Read more here : https://numbertheory.ai/

Number Theory recently got acquired by Newgen Software (https://newgensoft.com/newgen-acquisition-of-number-theory/) giving it a truly global reach.

To apply for this job email your details to hr@jobtrix.in

Job Overview
Job Location