the initial step with the catalyst optimizer is to be certain all of your references seem sensible. Do the column names your question contains exist? What columns are you currently attempting to filter on? It’s a series of verifications. in a large amount, these are generally dataframes without the schema and absence the catalyst optimiser acces