Associate Lead Engineer - BI job from Dialog Axiata PLC in Colombo, Sri Lanka
Wednesday 7th, July 2021
Colombo
Full-Time
IT-Software / Internet Telecommunications
Description
Implementation and configuration / new developments of Enterprise Big Data solutions as per Business Requirement while leading the smooth operationalization of platform. Also, to be able to architect the most optimized/suited big data solution for the business.
The Job
- Installation, configuration, and upgrading of Big Data solutions while leading the team for smooth operationalization
- Benchmark systems, analyze system bottlenecks and propose solutions to eliminate them
- Provide deep subject matter expertise, advice for the program delivery while establishing architectural principles and patterns
- Conduct technical and design reviews while understanding system integration concepts and patterns
- Review the business requirements captured and assess gaps
- Innovation role on Digital Data with latest technologies and identify customer expectations and competitor movements fast and accurate and same time coordination among organizational units to enhance operational backbone
- Carrying out R&Ds to select best suited Big Data technologies
- Design ETL flow using technologies such as Sqoop / Flume / Kafka / Hive / Oozie / PIG / AWS Glue / Airflow
- Responsible for performing monthly/quarterly performance analysis to identify the application bottlenecks, issues and new resources requirements while defining the process and continuous improvement
- Troubleshooting on system issues, attending to faults, analysis of issues, applying corrective action/workarounds, proving RCAs
- Periodically update relevant patches on Big Data platforms while assessment of the Big Data platform to identify gaps for patch and make long-term and short-term plans to bridge the gaps
- Perform Unix / Linux administrative tasks while planning and executing performance improvement activities essential to Maintain a smooth operational environment
- Implementing and managing OS-level security and patch upgrades while maintaining minimum baseline security of servers (Periodic VA Scans / Recommending patches)
- Maintaining up to date documentation, connectivity diagrams, and related information for all the applications liaised within the responsibility of this position
- Career path development and create Learning opportunities for subordinates
Entry Requirements
The Person
- More than 7 years experience in a relevant position in a similar field
- Bachelors’ degree in IT/Computer science from a recognized university
- Having Scalable Machine Learning certification, certified on Data warehousing with MSSQL Server, certified on Cloudera Developer for Apache Hadoop & Spark, certified on Cloudera Designing and Building Applications and AWS solution architect is advantageous
- Strong Knowledge Big Data related technologies (Hadoop, MapReduce, Pig, Hive, HBase, Oozie, Flume, ZooKeeper, Kafka, Spark, Solr, Impala, Hue)
- Knowledge on RDBMS (MySQL, Oracle), PLSQL, Shell Scripting, MySQL Clustering, Impala Load Balancing, NoSQL / column-oriented Databases (Preferred Snowflake / ClickHouse)
- Strong Programming skills with Scala / Python/ Java
Skills required
Excellent written and verbal communication skills in English
Strong Knowledge Big Data related technologies
Strong Programming skills with Scala / Python/ Java