Document the Iceberg split weight property
Cherry-pick of
@@ -29,9 +29,9 @@ Configuration Properties
The following configuration properties are available:
-====================================== ====================================================
+========================================= =====================================================
Property Name Description
-====================================== ====================================================
+========================================= =====================================================
``hive.metastore.uri`` The URI(s) of the Hive metastore.
``iceberg.file-format`` The storage file format for Iceberg tables.
@@ -47,7 +47,10 @@ Property Name Description
``iceberg.hadoop.config.resources`` The path(s) for Hadoop configuration resources.
``iceberg.max-partitions-per-writer`` The maximum number of partitions handled per writer.
-====================================== ====================================================
+
+``iceberg.minimum-assigned-split-weight`` A decimal value in the range (0, 1] used as a minimum
+ for weights assigned to each split.
+========================================= =====================================================
``hive.metastore.uri``
^^^^^^^^^^^^^^^^^^^^^^
@@ -114,6 +117,15 @@ The Maximum number of partitions handled per writer.
The default is 100.
+``iceberg.minimum-assigned-split-weight``
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+A decimal value in the range (0, 1] used as a minimum for weights assigned to each split.
+A low value may improve performance on tables with small files. A higher value may improve
+performance for queries with highly skewed aggregations or joins.
+
+The default is 0.05.
+
Nessie catalog
^^^^^^^^^^^^^^
