Hello, I'd like to get some help on compaction OOM in Spark. Calling rewrite_data_files on a relatively large partition in an AWS Glue 5.0 (Spark 3.5.4 and Iceberg 1. ...
'taskmanager.memory.task.off-heap.size': '10048m' 'taskmanager.memory.managed.fraction': '0.01' 2024-11-08 14:35:33,621 DEBUG org.apache.flink.runtime.jobmaster ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback