The Storage API streams data in parallel directly from BigQuery via gRPC without using Google Cloud Storage as an intermediary. It has a number of advantages over using the previous export-based read ...

Thank you for taking the time to explore data-related insights with me. I appreciate your engagement. If you find this information helpful, I invite you to follow me or connect with me on LinkedIn.

MySQL and PostgreSQL are two of the most used open source SQL databases, and both fulfill the role of a general-purpose database well. How do you choose which one to use for a project? Let's look at ...

From performance to programmability, the right database makes all the difference. Here are 13 key questions to guide your selection. Picking the “right” database can often be critical to the success ...

If you’ve always been in awe of folks using the Google Search Console API to do cool things, this article is a good read for you. You can use BigQuery with the GSC bulk data export to get some of the ...

Part of the SQL Server 2022 blog series. Time series data is a set of values organized in the order in which they occur and arrive for processing. Unlike transactional data in SQL Server, which is not ...

Dive into data lakes—what they are, how they're used, and how data lakes are both different and complementary to data warehouses. In 2011, James Dixon, then CTO of the business intelligence company ...

This project provides extensions to the Apache Spark project in Scala and Python: Diff: A diff transformation and application for Datasets that computes the differences between two datasets, i.e.