Dunno if a specific channel exists for this question: Using Connect with ODBC/JDBC driver. When using a GUI Client tool like DBeaver, I can

SELECT * FROM oa_tables

and it works. When using

pyspark

with the same user and role, I got

Invalid company/role qualification

. I double checked driver, settings, user, role, url, instance, etc. They are the same for both. Other tables I got without issue. Even using the spark

.option("dbtable", "oa_columns")

works, and gives the whole table, but the query option

.option("query", "select * from oa_columns")

fails for this table but works for any other table. Any hint would be appreciated.

Try upping the fetch size for spark Like

.option("fetchsize", 2000)

Oracle defaults to something super low