Performance Issue: materialize=True Causes Slowdown Due to Redshift Write Overhead

[amankushwaha25]

Hi,

I'm using Redshift as the database. When materialize=False, the diff prints quickly. When materialize=True, it takes much longer.
Does this indicate that computing the diff is fast, but writing the result to Redshift is the bottleneck?

[amankushwaha25]

@erezsh

[erezsh]

It does sound like it. If materialize is the only difference, and it causes a big slowdown, writing is probably the bottleneck.