Job Opportunity for Database Architect at Education Initiatives in Bengaluru

Type: Full time, Permanent

Location: Bangalore

Reports to: Chief Technology Officer

Looking for energetic, creative hands-on Data Warehouse Architect to be part of a fast paced, dynamic agile product engineering squad. Our ways of working help to reduce time to market and maximize value delivered through accelerating the product life cycle delivery and deployment.

As a Data Warehousing Architect, you would work with the product analysts, solutions architecture team, application development team to develop world class Data Warehouse and Data Marts to enable our internal and external customers to derive high-quality value from the data generated over a period from both the platforms and applications. Industry standard Data Warehousing tools and practices shall be employed. Looking at data holistically is key to ensure that our product, data analysis engineering, data modeling, ETL, and Business Intelligence work in harmony to fulfill the business strategy. You shall feel comfortable in an ambiguous situation and bring clarity to the team. You should also have a mindset to thrive on new technical challenges and help innovate our products, and technology stack.

You will work closely with the solutions engineering team to ensure the Data Warehouse being engineered is complete in all sense to answer the future questions that our customers may ask.

You shall also have demonstrated very good experience with agile, scrum, CI/CD, DevOps, leading architecture / design reviews and system engineering / administration for any commercial off the shelf tools in developer productivity, build & release management space.

B. Work Title

Principal Data Engineering Architect, Hands on Technical ICE Role

C. Position Accountability

1.Contribute towards building a strong product engineering culture as the team builds new product capabilities in modern technology.

2.Being a member of a Product Engineering team, deliver on the strategic road-map of an enterprise grade product.

3.Help the team to imbibe Agile values and principles effectively.

4.Analyze and be on top of business process, data, systems and lead efforts to build enterprise scale Analytics system.

5.Set direction and define architecture patterns and reference models for desired state integrated-data-store designs.

6.Spearhead modern data warehousing techniques and build a variety of modern Data warehouse solutions.

7.Evaluate and influence selection of data warehouse and business intelligence software.

8.Deliver innovation in design and solutions leveraging latest best practices Data warehouse, and Data Analytics.

9.Manage the planning and delivery of data warehouse and storage architecture.

10.Lead technical design and implementation of dashboards and reporting capabilities.

11.Analyze operational and analytical data requirements by working with business stakeholders, Product analysts, and technology teams.

12.Provide end-to-end oversight across projects to ensure Data Models and ETL/BI designs align to standards and best practices for achieving maximum consistency, performance and efficiency of the DW/BI ecosystem

13.Analyze requirements to create technical designs, data models and migration strategies

14.Solid understanding of systems engineering in relation to creating a high-performance BI architecture which will efficiently use CPU, memory, storage, caching, IO, etc.

15.Identify and recommend database performance solutions and standards.

16.Meet with various IT groups (other departments and computer operations’ staff) to address issues/concerns

17.Collaborate with all stakeholders to define and implement actionable metrics, KPIs and data visualizations

18.Implement data quality, data integrity, and data standardization efforts across products and databases enabling key business processes and applications

19.Recommend improvements to enhance existing ETL and data integration processes to enable performance and overall scalability

20.Evangelize across the team to adopt best practices, and continuously keep updated oneself on latest technologies.

21.Ensure the design proposal makes balanced trade-off across schedule, cost, technology, security, and compliance requirements.

22.Sets best practices for data systems development and diligently enforces them across the projects through combination of process, education, training, and sufficient review processes.

23.Works with end users to translate business questions and requirements into applications that employ the appropriate reporting tools.

24.Ensure quality of team members consistently meets/exceeds set standards and expectations.

25.Work with cross functional teams within engineering, usability team, product management, operations team, and customer support engineers to design and build solutions while mentoring and coaching developers.

26.Evaluate the technology, design of the component/feature and mentor the juniors in the team.

27.Develop a thorough understanding of the domain and influence the architecture roadmap.

D. Job Description

1.Analyze requirements, produce accurate, unambiguous technical design specifications to the appropriate detail

2.Plans, designs, develops, integrates application components and tests software systems or applications for software enhancements and new products. Write, debug, and deploy code to production; deliver timely fixes.

3.Deliver customer value in the form of high-quality software components and services in adherence with policies on security, performance, longevity and integration testing.

4.Be well versed in the latest development methodologies like Agile, Scrum, and DevOps.

5.Adhere to DOD (story definition of done) as part of the sprint, including unit tests, functional testing, code reviews, no regressions, bug fixes, documentation and adhere to best coding practices.

6.Develop both physical and logical data models.

7.Analyze all data warehouse architecture goals and identify skill requirement for same.

8.Assists in the evaluation, selection, testing, and optimization of BI/DW related hardware and software products.

9.Develops and applies sound fundamental design, analysis, and data administration concepts, practices, and procedures.

10.Transition data within/across traditional RDBMS, Massively Parallel Processing DW, modern cloud based DW

11.Build data warehouses, data marts on-premises/cloud

12.Ingest batch and streaming data, build ELT/ETL pipelines

13.Perform data profiling and quality analysis

14.Prepare designs for database systems and recommend improvements for performance.

15.Focuses on enterprise-wide data modeling and database design.

16.Maintain and develop various database scripts and tools to facilitate automation process.

17.Creates logical and physical data models, mapping logical to physical.

18.Understand and load dimensional data models.

19.Design, build, and maintain physical databases, dimensional data models, OLAP cubes, ETL layer design and data integration strategies

20.Develop various ETL processes, prepare OLAP cubes, and perform tests on data.

21.Prepare design for all metadata according to various ETL processes.

22.Perform troubleshoot on all ETL processes and resolve issues in Data ETL/warehouse/marts.

23.Assists in monitoring system performance, reliability, availability, and recoverability of the DW environment.

24.Designs and develops BI reporting deliverables

25.Prepare appropriate status reports and submit it to management.

26.Design holistic system, sub systems and develop system design document that outlines implementation scope for entire team; review get sign off from all stakeholders and set expectations.

27.Ensure alignment of data models within the enterprise data warehouse environment across conceptual, logical, and physical data models, whether overall or project/iteration level data model

28.Evangelize the use of data quality metrics and best practices from ingest to deliver

29.Partner with solution architects to align various project architectures with the overall vision and standards outlined

30.Investigate complex strategic business issues, researching and identifying innovative solutions

31.Partner closely with Business Analysts, Product Capability Managers, Technical Leads, other Solution Architects, internal stakeholders, and external customers to ensure alignment with projects, programs and strategies, and standards.

32.Guide test plan creation.

33.Participates in the design of the technical and information architecture for the data warehouse, including all information structures (staging area, data warehouse, data marts, and operational data stores).

34.Perform peer code reviews in order to ensure quality standards

35.Master the domain knowledge in the area of assignment

36.Take ownership of what the team builds after the release; consider customer adoption as success criteria

37.Volunteer for work in the backlog and commit to quality delivery; Coordinate efforts across the team to ensure completion and effectiveness

38.Participate and contribute to scrum meetings i.e. daily stand-up, sprint planning, readouts and retrospectives

39.Work collaboratively across the Technology and Product organizations to ensure alignment towards business goals

40.Should understand fundamentals of iterative product development.

41.Should understand the value of commitments to delivery made by a development team

42.As a member of technical staff, you’ll have the opportunity to grow as a software engineer in a culture of technical excellence, high team performance and impeccable work ethics.

Requirements

E.Technical Experience

1.Expertise in data warehouse modeling and implementation

2.Deep knowledge experience in Data Architecture, Data Warehouse Concepts, and enterprise scale Reporting and analytical systems

3.Must have experience in various data related roles including but not limited to data systems architecting, design and development, implementing large scale enterprise applications and analytical solutions and leading team of junior developers to deliver solutions

4.SQL ETL tools (e.g., Informatica, Talend, Pentaho, SSIS)

5.RDBMS (e.g., Oracle, DB2, SQL Server)

6.DW on cloud (e.g., Snowflake, Redshift, Azure Synapse)

7.Cloud environments (e.g., AWS, Azure, GCP)

8.Unix shell scripting Scheduling tools (e.g., Control-M, Autosys, Cron)

9.Experience in working with data marts and dimensional models (star, snowflake schema)

10.Experience in data modeling (data warehouse) will be an added advantage.

11.Hands-on experience with one or more ETL tools like Informatica PowerCenter, Talend, DataStage, ODI, BODS, Microsoft SSIS

12.Hands-on experience with one or more Cloud ETL/ELT – Matillion, Fivetran, Stitch, StreamSet, DBT, Striiim

13.Hands-on experience with one or more Data Replication tools – Qlik Replicate/Composite, HVR, Oracle GoldenGate, Informatica PowerExchange

14.Experience in cloud data migration project or building DW/Data Lake on Cloud Data Platform like Snowflake, Azure Synapse, AWS Redshift and/or BigQueryStrong skills in memory management and exception handling, knowledge in asynchronous programming practices.

15.Independently able to decide on strategy, design, develop and implement enterprise grade data warehouse system.

16.Experience with building high-quality software based upon architectural specifications.

17.Very comfortable using GIT version control tool (we use Bitbucket)

F.Academic and Professional Expertise 

1.Holds an academic degree in Computer Science, Computer Engineering or Computational Science.

2. 8 to 15+ years of working relevant experience

3.Ambitious individual who can work under their own direction towards agreed targets/goals.

4.Experience in working in Agile scrum teams.

5.Ability to handle change and be open to it along with good time management and an able to work under stress

6.Respond to technical queries / requests from team members and customers

7.Collaborate with various disciplines within engineering and outside such as product management, user experience, tech support and with customers to provide innovative solutions

8.Facilitate technical decisions; incorporate feedback and emergent patterns; ensure technical cohesion in product architecture

9.Experience in development and performance optimization of web applications, server components, database and web services

10.Experience with concurrent programming, scale-out distributed systems and test-driven development practices.

11.Strong troubleshooting and problem-solving skills.

12.Proven experience in Migrating applications.

13.Demonstrated ability to adapt and work with team members of various experience levels

14.Ability to work with minimal direction with a focus on customer satisfaction

15.Proven interpersonal skills while contributing to team effort by accomplishing related results as needed

16.Creative problem-solving skills and superb communication skills.