Job Opportunity for Data Engineer at Education Initiatives in Bengaluru

SBU

Software Development

Location

Bangalore

Role and Responsibilities

1. Analyze requirements, produce accurate, unambiguous technical design specifications to the appropriate detail.

2. Collaborate with cross functional squad members (product and tech teams) to help them understand and fully comply with data quality standards, architectural guidelines and designs.

3. Recommend and implement emerging database technologies.

4. Set and maintain database standards. Develop processes for establishing and sustaining impeccable database security.

5. Install database servers, maintain with constant upgrades (including security patches, and hotfixes) and sustain the highest performance.

6. Establish the needs of users and monitor user access and security. Performance tuning of database systems.

7. Map out the conceptual design for a planned database.

8. Own and manage all changes to the data models. Create data models, solution designs and data architecture documentation for complex information systems powering the EI product.

9. Install, upgrade, and manage database applications.

10. Diagnose and troubleshoot database errors.

11. Create and manage database reports, visualizations, and dashboards. Create automation for repeating database tasks.

12. Write database documentation, including data standards, procedures and definitions for the data dictionary (metadata). Ability to work independently with minimal supervision and assistance.

13. Plans, designs, develops, integrates database scripts to consuming application components and helps to test software systems or applications for software enhancements and new products. Write, debug, and deploy scripts to production; deliver timely fixes in close collaboration with Developers and DevOps.

14. Deliver customer value in the form of high-quality software components and services in adherence with policies on security, performance, longevity and integration testing.

15. Be well versed in the latest development methodologies like Agile, Scrum, DevOps and unit testing for database scripts during development.

16. Adhere to DOD (story definition of done) as part of the sprint, including unit tests, functional testing, code reviews, no regressions, bug fixes, documentation and adhere to best coding practices.

17. Perform peer code reviews in order to ensure quality standards

18. Master the domain knowledge in the area of assignment

19. Take ownership of what the team builds after the release; consider customer adoption as success criteria

20. Volunteer for work in the backlog and commit to quality delivery; Coordinate efforts across the team to ensure completion and effectiveness

21. Participate and contribute to scrum meetings i.e. daily stand-up, sprint planning, readouts and retrospectives

Skillset

Must have

1. 3+ years of experience working with different databases like MySQL, Postgres, MongoDB, Redis, Elasticsearch, Redshift, Clickhouse etc.

2. Very good hands-on experience with programming language, preferred are Python and SCALA. ETL packages Pandas or PySpark.

3. Excellent problem-solving and analytical skills.

4. Familiarity with the main data manipulation languages and the principles of database design. Advanced knowledge of database structure and theory.

5. Ability to write and troubleshoot complex queries in various SQL and NoSQL databases.

6. Basic understanding of disaster recovery and database backup procedures.

7. Experience with building high-quality software based upon architectural specifications.

8. Experience in NoSQL databases (e.g., MongoDB, Cassandra)

9. Very comfortable using GIT version control tool (we use Bitbucket)

10. Familiarity with reporting tools.

11. Ability to setup, monitor and troubleshoot CRON jobs

12. Ability to setup data pipelines, data lakes and data warehouses

13. Experience with data cleaning, data manipulation and data management skills

14. Certification in AWS Cloud Services is a bonus

Education

Holds an academic degree in Computer Science, Computer Engineering or Computational Science.

Experience

1. 3+ years of experience working with different databases like MySQL, Postgres, MongoDB, Redis, Elasticsearch, Redshift, Clickhouse etc.

2. 3+ years of working experience as hands on industry experience.

3. Ambitious individual who can work under their own direction towards agreed targets/goals.

4. Good technical knowledge of databases and query languages.

5. Ability to handle change and be open to it along with good time management and an able to work under stress.

6. Respond to technical queries / requests from various team members and customers.

7. Collaborate with various disciplines within engineering and outside such as product management, user experience, tech support and with customers to provide innovative solutions.

8. Facilitate technical decisions; incorporate feedback and emergent patterns; ensure technical cohesion in product architecture.

9. Experience in development and performance optimization of different databases and services.

10. Strong troubleshooting and problem-solving skills.

11. Proven experience in Migrating database.

12. Demonstrated ability to adapt and work with team members of various experience levels.

13. Ability to work with minimal direction with a focus on customer satisfaction.

14. Proven interpersonal skills while contributing to team effort by accomplishing related results as needed.

15. Creative problem-solving skills and superb communication skills