• my name is meor hasyim. i work as a data operations at 2x marketing.
• as a data ops here, i responsible to build and maintain data pipelines using bigquery.
• most of the time, i spend countless hour troubleshooting data quality issues including data normalization, inconsistency formatting, etc.
• here i learnt a lot about data warehousing, schema design, best practice for sql queries, efficient table joining and many more!
• integration: stitch
• warehousing/storage: bigquery
• visualization: looker studio
• previously a data engineer at opensoft technologies.
• one thing that i missed working at here is the freedom to go wild installing things in a server, literally from scratch.
• my responsibility here is a lot more technical compared to current one, since i have to own the server itself instead of just tools.
• i learnt a lot about linux computing, networking, server administration here.
• due to multiple ongoing projects from different clients, i also covered multiple data tools here.
• integration: talend, rapidminer,
apache nifi
• warehousing/storage: apache hadoop, apache hive, mysql,
mariadb, postgresql
• visualization: tableau, powerbi