Blog

Data Warehouse Engineering and Technology

xdrive kafka

Parallel data transfer between Deepgreen and Kafka (Data in JSON format)

by Eric Lam

Today, we will talk about how to transfer the data in JSON format from Kafka to Deepgreen. It reads the data from Kafka partitions simultaneously via Xdrive plugins and transfer the data to Deepgreen DB table.

We will show you how to setup the configurations and read the JSON data from Kafka today.

Read more...

xdrive kafka

Parallel data transfer between Deepgreen and Kafka via Xdrive

by Eric Lam

Deepgreen just released the latest Kafka extension dgkafka that can read/write data between Deepgreen and Kakfa in parallel fashion. It reads the data from Kafka partitions simultaneously via Xdrive plugins and transfer the data to Deepgreen DB table.

We will show you how to setup the configurations and read the data from Kafka today.

Read more...

machine learning

Introduction to Machine Learning with Tensorflow and Deepgreen Transducer

by Eric Lam

Today, we will show you how to build machine learning models with tensorflow and transducer.

Deepgreen Transducer is the scripting relational database engine that is tightly integrated with relation engine, including query optimizer, query executor and can be executed in parallel with other query operators. With transducer, we can efficiently execute queries that are very difficult to express in SQL. See Scripting Relational Database Engine Using Transducer.

Read more...

greenplum

Catalog Corruption in Greenplum DB

by CK Tan

Recently one of our clients experienced catalog corruption in Greenplum DB after a power outage.

Read more...

postgres sql

Comparing Tables in Postgres

by CK Tan

How to tell if two tables are exactly the same?

Read more...