navinkumar (@navinkumar05)

Data Engineering Roadmap

Introduction Many people step out of the Data Engineering learning journey because everything feels confusing, slow, and overwhelming. But the real problem isn’t the tools, it’s the lack of a clear purpose and a clear path. To solve this problem, I c...

Nov 29, 2025 · 2 min readnotes123.hashnode.dev

Incremental Load in Data bricks part -1

Use cases Suitable if the pipeline runs infrequently. Assume the scenario if files are loaded in same directory everyday. If not used processed and yet to process folder. Steps to implement List the current files in directory create database if...

Nov 28, 2024 · 1 min readnotes123.hashnode.dev

List comprehension vs Generator expression

syntax List comprehension [expression for item in iterable if condition] Generator expression (expression for item in iterable if condition) only difference is [] & () How Generator Expression Works: Initialization: When you create a generator...

Jul 14, 2024 · 4 min readnotes123.hashnode.dev

connect Postgres SQL in python

Pre-requisites: Postgres database Python step -1 pip install psycopg2-binary step -2 postgres credentials host='localhost' dbname='practice_db' username='postgres' password=123456 port=5432 step -3 import the pscopg2 module and use the connect ...

Jul 9, 2024 · 1 min readnotes123.hashnode.dev

Java JDBC

package jdbc; import java.sql.*; public class PostgreSQLCRUDExample { // JDBC URL, username, and password static final String JDBC_URL = "jdbc:postgresql://localhost:5432/practicedb"; static final String USERNAME = "postgres"; static...

Jun 1, 2024 · 2 min readnotes123.hashnode.dev

navinkumar

About

Available for

navinkumar's blogs

Data Engineering Roadmap

Incremental Load in Data bricks part -1

List comprehension vs Generator expression

connect Postgres SQL in python

Java JDBC

navinkumar

About

Available for

navinkumar's blogs

Data Engineering Roadmap

Incremental Load in Data bricks part -1

List comprehension vs Generator expression

connect Postgres SQL in python

Java JDBC

navinkumar

About

Available for

navinkumar's blogs

Data Engineering Roadmap

Incremental Load in Data bricks part -1

List comprehension vs Generator expression

connect Postgres SQL in python

Java JDBC

Search Hashnode

navinkumar

About

Available for

navinkumar's blogs

Data Engineering Roadmap

Incremental Load in Data bricks part -1

List comprehension vs Generator expression

connect Postgres SQL in python

Java JDBC