Job Opportunity for Database Engineer at Education Initiatives in Bengaluru

Type: Full time, Permanent

Location: Bangalore

Reports to: Database Engineering Manager

Looking for energetic, creative and hands-on Data Engineer who will be responsible for the ETL, data/report dashboards, performance, modification, integrity and security of a database and data warehouse.

As a Data Engineer, you will be responsible to select and integrate any Big Data tools and frameworks required to provide requested capabilities. Implement a solid ETL process. Monitor performance and advice any necessary infrastructure changes. Define data collection, retention and archiving policies. You will often work with problems associated with database integration and messy, unstructured data sets. The aim is to provide clean, usable data. You need to ensure that data remains consistent across the databases, data is clearly defined, users access data concurrently, in a form that suits their needs

You will work closely with software development team and IT Infra team for planning and development of database in cloud as well as local servers.

You shall also have demonstrated very good experience with agile, scrum, CI/CD, DevOps, leading architecture / design reviews and system engineering / administration using any commercial off the shelf tools in developer productivity, build & release management space.

B. Work Title

Data Engineer

C. Position Accountability

1. Contribute towards building a strong product engineering culture as the team builds new product capabilities in modern technology.

2. Your responsibility as a Data Engineer will be the ETL, managing data/report dashboards, performance, integrity and security of a database and data warehouse.

3. Effectively articulate the rationale behind the data model design decisions.

4. Strategically incorporate team members feedback to produce the highest quality data models.

5. Involve in the planning and development of the database, as well as in troubleshooting any issues on behalf of the users.

6. Ensure that data remains consistent across the database, data is clearly defined.

7. Ensure that Users access data concurrently, in a form that suits their needs there is provision for data security and recovery control (ensuring all data is retrievable in an emergency).

8. Author, review and execute the queries on production environment.

9. Fulfill the data need by creating and running the queries on database.

10. Help the team to imbibe Agile values and principles effectively.

11. Work with cross functional teams within engineering, usability team, product management, operations team, and customer support engineers to design and build solutions while mentoring and coaching junior members of the team.

12. Develop a thorough understanding of the domain and influence the architecture roadmap.

D. Job Description

1. Analyze requirements, produce accurate, unambiguous technical design specifications to the appropriate detail.

2. Collaborate with cross functional squad members (product and tech teams) to help them understand and fully comply with data quality standards, architectural guidelines and designs.

3. Recommend and implement emerging database technologies.

4. Set and maintain database standards. Develop processes for establishing and sustaining impeccable database security.

5. Install database servers, maintain with constant upgrades (including security patches, and hotfixes) and sustain the highest performance.

6. Establish the needs of users and monitor user access and security. Performance tuning of database systems.

7. Map out the conceptual design for a planned database.

8. Own and manage all changes to the data models. Create data models, solution designs and data architecture documentation for complex information systems powering the EI product.

9. Install, upgrade, and manage database applications.

10. Diagnose and troubleshoot database errors.

11. Create and manage database reports, visualizations, and dashboards. Create automation for repeating database tasks.

12. Write database documentation, including data standards, procedures and definitions for the data dictionary (metadata). Ability to work independently with minimal supervision and assistance.

13. Plans, designs, develops, integrates database scripts to consuming application components and helps to test software systems or applications for software enhancements and new products. Write, debug, and deploy scripts to production; deliver timely fixes in close collaboration with Developers and DevOps.

14. Deliver customer value in the form of high-quality software components and services in adherence with policies on security, performance, longevity and integration testing.

15. Be well versed in the latest development methodologies like Agile, Scrum, DevOps and unit testing for database scripts during development.

16. Adhere to DOD (story definition of done) as part of the sprint, including unit tests, functional testing, code reviews, no regressions, bug fixes, documentation and adhere to best coding practices.

17. Perform peer code reviews in order to ensure quality standards

18. Master the domain knowledge in the area of assignment

19. Take ownership of what the team builds after the release; consider customer adoption as success criteria

20. Volunteer for work in the backlog and commit to quality delivery; Coordinate efforts across the team to ensure completion and effectiveness

21. Participate and contribute to scrum meetings i.e. daily stand-up, sprint planning, readouts and retrospectives

22. Work collaboratively across the Technology and Product organizations to ensure alignment towards business goals

23. Should understand fundamentals of iterative product development.

24. Should understand the value of commitments to delivery made by the development team.

Requirements

E. Technical Experience

1. 3+ years of experience working with different databases like MySQL, Postgres, MongoDB, Redis, Elasticsearch, Redshift, Clickhouse etc.

2. Very good hands-on experience with programming language, preferred are Python and SCALA. ETL packages Pandas or PySpark.

3. Excellent problem-solving and analytical skills.

4. Familiarity with the main data manipulation languages and the principles of database design. Advanced knowledge of database structure and theory.

5. Ability to write and troubleshoot complex queries in various SQL and NoSQL databases.

6. Basic understanding of disaster recovery and database backup procedures.

7. Experience with building high-quality software based upon architectural specifications.

8. Experience in NoSQL databases (e.g., MongoDB, Cassandra)

9. Very comfortable using GIT version control tool (we use Bitbucket)

10. Familiarity with reporting tools.

11. Ability to setup, monitor and troubleshoot CRON jobs

12. Ability to setup data pipelines, data lakes and data warehouses

13. Experience with data cleaning, data manipulation and data management skills

14. Certification in AWS Cloud Services is a bonus

F. Academic and Professional Expertise

1. Holds an academic degree in Computer Science, Computer Engineering or Computational Science.

2. 3+ years of working experience as hands on industry experience.

3. Ambitious individual who can work under their own direction towards agreed targets/goals.

4. Good technical knowledge of databases and query languages.

5. Ability to handle change and be open to it along with good time management and an able to work under stress.

6. Respond to technical queries / requests from various team members and customers.

7. Collaborate with various disciplines within engineering and outside such as product management, user experience, tech support and with customers to provide innovative solutions.

8. Facilitate technical decisions; incorporate feedback and emergent patterns; ensure technical cohesion in product architecture.

9. Experience in development and performance optimization of different databases and services.

10. Strong troubleshooting and problem-solving skills.

11. Proven experience in Migrating database.

12. Demonstrated ability to adapt and work with team members of various experience levels.

13. Ability to work with minimal direction with a focus on customer satisfaction.

14. Proven interpersonal skills while contributing to team effort by accomplishing related results as needed.

15. Creative problem-solving skills and superb communication skills.