Introducing Crunchy Data Warehouse: A next-generation Postgres-native data warehouse. Crunchy Data Warehouse Learn more
Dave Cramer
Dave Cramer
My colleague @craigkerstiens recently wrote about some guidance for cleaning up your Postgres database . One of the things he mentioned in his post, "Don't put your logs or messages in your database." got a number of questions from people similar to: "But what do I do with my logs such as for an audit purpose?" Well there is a great answer and it does play really well with Postgres. The answer in many cases is, "Use Debezium." Debezium is built upon the Apache Kafka project and uses Kafka...
Read MoreDave Cramer
Dave Cramer
As you can see from my previous blogs ( A Guide to Building an Active-Active PostgreSQL Cluster ) I’m interested in the ways that we can replicate data in PostgreSQL. For this post, I've decided to write about a product that enabled replicating heterogeneous databases. Through my involvement in the PostgreSQL JDBC project, I’ve had the opportunity to help out the folks in the Debezium project. Debezium is more than just another heterogeneous replication solution. Debezium is built upon the Ap...
Read MoreDave Cramer
Dave Cramer
Kubernetes is a very popular container orchestration framework. I’ll show you how to get Symmetric-DS working on a single Kubernetes instance. I had previously explored how to build an active-active PostgreSQL cluster using Symmetric-DS. The steps are essentially the same on Kubernetes: 1. Start 2 PostgreSQL pods 2. Create a user and a database on each pod/instance 3. Start the primary symmetric-ds pod 4. Add the symmetric-ds triggers and routes 5. Open registration 6. Start the secondary s...
Read MoreDave Cramer
Dave Cramer
One of the toughest challenges facing database engineers today is ensuring their data is always accessible so they can meet the high-availability requirements for their applications. While this problem may seem trivial in the world of applications where one can have many instances behind geographically distributed load balancers, in the database world where there is only one version of the data globally, the problem faces many obstacles. PostgreSQL replication has advanced considerably in rece...
Read More