Yousry Mohamed – Medium

Yousry Mohamed

Yousry Mohamed

·

Apr 7

Time is hard : Databricks SQL functions and time zone closures!!

Introduction

Time is hard : Databricks SQL functions and time zone closures!!

In

Level Up Coding

by

Yousry Mohamed

·

Jun 29, 2025

Variant Type : A Deep Dive into the Semi-Structured Lake

Explore the ins and outs of the variant data type and how it balances performance and flexibility for semi-structured data in the…

Variant Type : A Deep Dive into the Semi-Structured Lake

In

Level Up Coding

by

Yousry Mohamed

·

Apr 27, 2025

Accelerate data engineering chores: Leverage MCP servers and AI to speed up development.

Accelerate data engineering chores: Leverage MCP servers and AI to speed up development.

In

Level Up Coding

by

Yousry Mohamed

·

Jan 3, 2025

Resurrecting Scala in Spark : Another tool in your toolbox when Python and Pandas suffer

Spark Dataset API is still useful to handle some edge cases that require extra flexibility but still run super fast.

Resurrecting Scala in Spark : Another tool in your toolbox when Python and Pandas suffer

In

Level Up Coding

by

Yousry Mohamed

·

Sep 7, 2024

Stop using plain PySpark UDFs : No one likes slow cars! Part II

Quick insights about how Pandas UDFs work

Stop using plain PySpark UDFs : No one likes slow cars! Part II

In

Level Up Coding

by

Yousry Mohamed

·

Jul 18, 2024

Stop using plain PySpark UDFs : No one likes slow cars!

How complex logic can be still implemented using out of the box Spark functions with lightning fast performance.

Stop using plain PySpark UDFs : No one likes slow cars!

In

Level Up Coding

by

Yousry Mohamed

·

Jan 28, 2024

Delta Lake Liquid Clustering — A visual explanation

How to optimize lakehouse data storage layout with minimal effort.

Delta Lake Liquid Clustering — A visual explanation

In

Level Up Coding

by

Yousry Mohamed

·

Dec 17, 2023

Building a lakehouse on Google Cloud sans Databricks

Combining Delta Lake, Iceberg and BigLake

Building a lakehouse on Google Cloud sans Databricks

In

Level Up Coding

by

Yousry Mohamed

·

Dec 5, 2023

Navigating the Void: Unraveling the Mysteries and Pitfalls of the ‘Void’ Data Type in Apache Spark

Exploring how a void column appears into Spark DataFrames and what could be the implications.

Navigating the Void: Unraveling the Mysteries and Pitfalls of the ‘Void’ Data Type in Apache Spark

In

Level Up Coding

by

Yousry Mohamed

·

Aug 29, 2023

Setting up a PySpark local developmet environment for Dataproc serverless

Smooth dependency managment for local developmet and production jobs

Setting up a PySpark local developmet environment for Dataproc serverless

Yousry Mohamed

Yousry Mohamed

Yousry is a principal data engineer working for Mantel Group. He is very passionate about all things data including Big Data, Machine Learning and AI.

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech