Fix the issue with ADLSGen2 connector when writing a file
412 error has been introduced after the client version bump.
This is because the behavior change from the ADLSGen2 client.
For more context, please check:
@@ -657,7 +657,7 @@ public class ADLSGen2PinotFS extends BasePinotFS {
totalBytesRead += bytesRead;
}
// Call flush on ADLS Gen 2
- fileClient.flush(totalBytesRead);
+ fileClient.flush(totalBytesRead, true);
return true;
} catch (DataLakeStorageException | NoSuchAlgorithmException e) {
