This is a cross-posting from https://www.intermix.io/blog/how-to-fix-disk-based-queries-amazon-redshift/ Table of Contents The WLM and Disk-Based queriesHow to Prevent Queries From Going Disk-basedIntermediate StorageWays to Limit the Amount of Intermediate Storage Used.Impact to Cluster Storage UtilizationConclusionProperly managing storage utilization is critical to performance and optimizing the cost

This is a cross-posting from https://medium.com/udemy-engineering/improving-amazon-redshift-performance-our-data-warehouse-story-5ec1282c13d8#:~:text=The concept is simple%3A for,EVEN%2C ALL%2C and KEY. Credit: pixabay.comIt is challenging to manage an optimized Amazon Redshift cluster. Scaling the cluster to meet your growing storage and computation needs while maintaining optimized performance

This is a cross-posting from https://www.intermix.io/blog/short-query-acceleration/ In November 2017, AWS introduced Short Query Acceleration (SQA) for Amazon Redshift. The promise of SQA is to speed up the execution of short running queries, with better predictability of query execution times. That, of course, sounds amazing. In

This is a cross-posting from https://www.intermix.io/blog/3-mistakes-redshift-setup/ Table of Contents Setting up Redshift Clusters: Don't Use the MasteruserSetting Up Redshift Clusters: Don't use a Single SchemaSetting up Redshift Clusters: Don’t use the default WLM queueConclusionAmazon Redshift is a petabyte-scale data warehouse that has been widely

This is a cross-posting from https://www.intermix.io/blog/modern-etl-tools-for-amazon-redshift/ Amazon Redshift was introduced in 2012 as the first Cloud Data Warehouse. It quickly became the fastest-growing service among Amazon Web Services. Amazon Redshift and these ETL tools forever changed the methods of working with analytical data. Let’s

This is a cross-posting from https://www.intermix.io/blog/14-data-pipelines-amazon-redshift/ Table of Contents 1. Simple2. Clearbit3. 500px4. Netflix5. Yelp6. Gusto7. Teads8. Remind9. Robinhood10. Dollar Shave Club11. Coursera12. Wish13. Blinkist14. Halodoc15. iHeartRadioHow Will You Build Your Data Pipeline?1. SimpleGetting data-driven is the main goal for Simple. It’s important

This is a cross-posting from https://www.intermix.io/blog/4-simple-steps-to-set-up-your-wlm-in-amazon-redshift-the-right-way/ One of the major propositions of Amazon Redshift is simplicity. It only takes minutes to spin up a cluster. The time-to-first-report, i.e. the time it takes to go from creating a cluster to seeing the results of your

This is a cross-posting from https://www.intermix.io/blog/top-14-performance-tuning-techniques-for-amazon-redshift/ Amazon Redshift is a data warehouse that makes it fast, simple and cost-effective to analyze petabytes of data across your data warehouse and data lake. Amazon Redshift can deliver 10x the performance of other data warehouses by using a

This is a cross-posting from https://www.intermix.io/blog/amazon-redshift-spectrum-how-it-works/ Table of Contents Amazon Redshift Spectrum for Analyzing Data in Amazon S3A Closer Look: How Does Amazon Redshift Spectrum Work?Joining Internal and External Tables with Amazon Redshift SpectrumAmazon Redshift Spectrum: Why It Makes SenseS3 (Simple Storage Service) has

This is a cross-posting from https://www.intermix.io/blog/improve-redshift-copy-performance/ Table of Contents IntroductionImproving Redshift COPY Performance: The COPY CommandImproving Redshift COPY Performance: What is “UPSERT”?Improving Redshift COPY Performance: Eliminating Unnecessary QueriesIntroductionAmazon Redshift is an excellent choice for cloud data warehousing—but how do you move your data