Release v5.19.0

What's Changed

Turning CORS back on for master by @jackyalbo in #8573
NC | NSFS | Wrap with try-catch Prometheus Reporting start_server by @shirady in #8559
Bumping deps to avoid CVE (01/12/2024) by @liranmauda in #8566
Minor fixes to md_blow by @jackyalbo in #8578
[GLACIER] Send x-amz-restore header as one single header instead of 2 headers with same name by @tangledbytes in #8576
NC | NSFS | Change printing of Warning stuck buffer_pool buffer from console.warn to console.error by @shirady in #8580
NC | Online Upgrade | Health CLI update config directory and upgrade checks by @romayalon in #8532
NSFS | Replace ChunkFS with FileWriter by @romayalon in #8577
NSFS | noobaa-cli Help format Update by @naveenpaul1 in #8581
CI | Nightly RPM Build - Master Branch - Fails (Arch ppc64le) by @naveenpaul1 in #8597
Remove NSFS_BUF_SIZE from nsfs_config_schema by @romayalon in #8602
Delete nightly rpm stage 5.15 build by @romayalon in #8601
NC | generate_entropy() - add /dev/nvme0 disks to the supported devices by @romayalon in #8600
Fix RPM build for macs by @tangledbytes in #8270
NC | Online Upgrade | Fail config directory upgrade if upgrade is already in progress by @romayalon in #8613
Bucket Notifications - PR notes, take 2 by @alphaprinz in #8593
NSFS | S3 throwing error for empty header and default port for STS by @naveenpaul1 in #8579
CI | Update Ceph S3 Tests + Ignore Failing Tests by @shirady in #8621
Makefile | Edit run-single-test with additional logs by @shirady in #8622
NC | Online Upgrade | Replace failure if system.json contains hosts that do not exist in --expected_hosts with a warning by @romayalon in #8612
NC | generate_entropy() - remove /dev/nvme0 from the supported devices list by @romayalon in #8614
NC | Online Upgrade | Short refactoring by @romayalon in #8615
NC | Add missing default rpc_code for unmapped errors by @romayalon in #8625
NC | NSFS | Add stat to account_cache by @shirady in #8585
Reducing NooBaa Upstream Image Size by @liranmauda in #8567
Bumping deps to avoid CVE (30/12/2024) by @liranmauda in #8634
Bucket Notifications - fix event typo after schema change by @alphaprinz in #8631
CI | Add Validate package-lock.json Tests by @liranmauda in #8640
NC | Fix test_nc_upgrade_manager cleanup by @romayalon in #8636
CI | Reduce run time | Convert test_file_writer to jest by @liranmauda in #8637
NC | Online Upgrade | add host config dir version to system.json | Health - add blocked hosts check by @romayalon in #8627
NC | Online upgrade improvements by @romayalon in #8638
bucket notifications - get notif should clone result before altering it (dfsbugs 1286) by @alphaprinz in #8657
bucket notifications - fix TopicConfiguration array for get (github issue 8647) by @alphaprinz in #8655
bucket notifications - go on to next event when checking event filters (gh issue 8652) by @alphaprinz in #8659
Added restriction to limit the ID length to 255 characters in bucket lifecycle rules by @achouhan09 in #8628
Added a check for duplicate Id in bucket lifecycle rules by @achouhan09 in #8629
bucket notification - ensure all lines in a persitent log are processed (gh issue 8653) by @alphaprinz in #8662
NC | Fix for NooBaa CLI not creating events by @romayalon in #8671
NC | Online Upgrade events by @romayalon in #8670
NC | Online Upgrade | Add nc_upgrade_manager.upgrade_config_dir() unit tests by @romayalon in #8645
NSFS | NC | add option to set account supplemental groups by @nadavMiz in #8552
Bumping node from v22.4.1 to v22.11.0 by @liranmauda in #8674
NC | Online Upgrade | Tests | Config directory restructure upgrade script unit tests by @romayalon in #8654
NC | NSFS | Add Module (dev-dependency) iam-client For Integration Tests by @shirady in #8681
Bumping deps to avoid CVE (13/01/2025) by @liranmauda in #8679
Noobaa/Quota: Provide correct error message by @aspandey in #8668
NC | NSFS | Add stat to account_id_cache by @shirady in #8642
bucket notification - introduce batch param by @alphaprinz in #8685
bucket notifications - allow empty notifications content to facilitate notification conf removal by @alphaprinz in #8692
Added a fix for handling invalid_schema_error returning with invalid status value for bucket lifecycle configuration rule by @achouhan09 in #8664
NC | NSFS | Fix Issue DFBUGS-1307 | Bucket Policy With Principal as ID by @shirady in #8680
Upgrade utils | change variables, errors and log prints to be general to both Containerized and NC environments by @romayalon in #8696
NC | Online Upgrade | Integration tests | Add CLI and S3 integration tests by @romayalon in #8682
NC | Online Upgrade | Documentation by @romayalon in #8694
SSL | Secure service for Noobaa metric by @naveenpaul1 in #8673
Move docs from the operator repo by @Neon-White in #8683
NC | RPM build and install github action by @romayalon in #8701
Fix python version to 3.9 to fix builds on RHEL 8 by @tangledbytes in #8702
NC | NSFS | IAM | Tech Debts (IAM Integration Tests, Username Validation Move module and Allow IAM User to Create Bucket) by @shirady in #8661
CI | Increase Timeouts by @shirady in #8705
remove librdkafka/examples directory from our image - in order to decrease its size by @jackyalbo in #8703
bucket notifications - add action to encrypt connection file by @alphaprinz in #8684
NSFS | add option to unset supplemental groups using noobaa cli by @nadavMiz in #8713
Changing get bucket encryption defaults by @jackyalbo in #8716
Update ceph_s3_tests_pending_list_status.md by @jackyalbo in #8719
bucket notification - ignore failure if notification was removed by @alphaprinz in #8709
NSFS | set supplemental groups dynamically to users groups by @nadavMiz in #8687
bucket notifications - events for scale by @alphaprinz in #8708
bucket notifications - missing await in failure handling, default topic_configuration in put by @alphaprinz in #8724
NC | Online Upgrade Tests | convert hard coded version to pkg.version by @romayalon in #8731
bucket notifications - validate notifications on change (gh issue 8649) by @alphaprinz in #8667
Bump version to 5.19.0 by @liranmauda in #8717
NC | Related to Issue 8598 | generate_entropy() - Add Disks (Temporary and Partial Fix) by @shirady in #8734
Adding upgrade script to bucket CORS - new bucket default will be the same as in 5.18 by @jackyalbo in #8729
Fix to break semaphore circular dependency by @jackyalbo in #8728
notifications | unit tests by @alphaprinz in #8497
Fix key and bucket length checks by @tangledbytes in #8715
Bumping deps to avoid CVE (03/02/2025) by @liranmauda in #8749
CORS - Fixing max_age_seconds to number and not string by @jackyalbo in #8754
bucket notifications - adapt to xml conversion by @alphaprinz in #8745
bucket notifications - fix and improve error output for test notif by @alphaprinz in #8764
nope-ip removal - Phase 1 by @liranmauda in #8714
FIx Request Handling on Requests with Trailing Headers (Mainly in ChunkedContentDecoder) by @shirady in #8753
Update AWS_API_Compatibility.md - Adding CORS by @jackyalbo in #8770
NSFS | versioning | add direcory content versioning PUT action by @nadavMiz in #8730
Code maintenance | Clean dead code from net_utils | nope-ip removal - Phase 2 by @liranmauda in #8771
Docs | Add ChunkedContentDecoder Documentation with State Machine Diagram by @shirady in #8778
NC | NSFS | CLI | Separate Bucket and Account List Functions by @shirady in #8747
NC | CLI | Fix for unsettable flags issues by @romayalon in #8774
NSFS | add configuration flag to enable dynamic supplemental groups allocation by @nadavMiz in #8769
NC | CLI | Updated the CLI response to have more info when account/bucket has been deleted by @achouhan09 in #8723
nope-ip removal - Phase 3 by @liranmauda in #8779
NC | Test Files | Remove nsfs From File Name and Update Docs by @shirady in #8780
Setting active_root_key parallel to loading key by @jackyalbo in #8788
Add http://{endpoint_address}:{s3_port}/_/version api to the endpoint by @romayalon in #8786
NC | Online upgrade | convert --expected_hosts flag from required to optional by @romayalon in #8790
persistent logger (for bucket notifications) - don't log rename ENOENT if there were no failures by @alphaprinz in #8765
NSFS | versioning | add comment and documentation about multipart upload version-id by @nadavMiz in #8785
bucket notification - harden bad name scenario. Also, don't reply internal '_' field. by @alphaprinz in #8796
NC | CLI | Added a validation to check if whitespace is not trimmed from string value for a flag by @achouhan09 in #8722
NSFS check_md_conditions for GET/HEAD (not yet for PUT/DELETE) by @guymguym in #8799
NC | CLI | List Accounts When Decrypt Access Keys Fails by @shirady in #8781
NC | Multi Protocol Access | List object with conflicting ownership by @naveenpaul1 in #8751
noobaa-core: Bucket Policy Condition to access Specific VersionID by @aspandey in #8776
NSFS | versioning | content directory versioning - GET/HEAD/DELETE operations by @nadavMiz in #8773
Bumping deps to avoid CVE (24/02/2025) by @liranmauda in #8822
S3 | GET/HEAD Object | Add Response Headers Support by @romayalon in #8812
bucket notifications - wrong etag, size by @alphaprinz in #8819
NC | Tests | test_bucketspace_fs.js leaves a fd opened by @romayalon in #8825
NSFS | NC | whitelist cli create config.json when it doesn't exist by @nadavMiz in #8813
Removing kube_pv_chown by @jackyalbo in #8827
By default disable node disconnect on error and IO detention by @dannyzaken in #8828
NC | GPFS | Config Files | Create Config Files Size 0 Bug Fix by @romayalon in #8824
NSFS | versioning | fix nested object concurrency issue by @nadavMiz in #8829
Adding ading functions to net_utils.js | nope-ip removal - Phase 4 by @liranmauda in #8787
NSFS | close stream when getting empty content dir by @nadavMiz in #8811
NC | NSFS | IAM | Doc | Minor Doc Update by @shirady in #8837
Moving root_secret load to P.map and loading the latest keys first by @jackyalbo in #8832
bucket notifications - add connection test to health by @alphaprinz in #8833
NC | CLI | List bucket dose not return full bucket name with .json suffix by @naveenpaul1 in #8806
NC | CLI | Lifecycle worker by @romayalon in #8839
NC | Fix node warning: Accessing non-existent property 'key' of module exports inside circular dependency by @romayalon in #8842
NSFS | Fix delete last object deletes directory object if its size is 0 by @romayalon in #8808
Add Problem description to PR template by @nimrod-becker in #8854
NSFS | Fix Bug | Race Between List Object and Delete Object by @shirady in #8809
Doc | Add Dev Guide Run Tests From coretest Locally by @shirady in #8855
NC | lifecycle | add option to abort multiple uploads by @nadavMiz in #8853
NC | Lifecycle | Add lock to lifecycle worker by @romayalon in #8858
Bucket Notifications - doc by @alphaprinz in #8557
Fix RPM build on RHEL8 & friends by @tangledbytes in #8843
Added an index for deleted unreclaimed blocks by @dannyzaken in #8865
Disable dedup indexer by default by @dannyzaken in #8868
bucket notifications - add notif storage test to health by @alphaprinz in #8850
[NC | NSFS] add support for DMAPI xattr based GLACIER storage class by @tangledbytes in #8028
[NSFS | Glacier] Add support force expiry based on GET completions and migration log size by @tangledbytes in #8810
Bumping deps to avoid CVE (16/03/2025) by @liranmauda in #8869
NC | Lifecycle | Status, Events, Timeout by @romayalon in #8860
NC | lifecycle - add expire rule by @nadavMiz in #8862
Fix id parse for s3_put_bucket_cors by @jackyalbo in #8874
NC | Lifecycle | Small configuration adjustments/ fixes by @romayalon in #8875
lifecycle | lifecycle pre test setup by @naveenpaul1 in #8844
Remove uuid module and replace it with the native crypto.randomUUID() by @liranmauda in #8876
Change Log Printing in namespace_monitor by @shirady in #8871
[NC | Glacier] Fix migrate.log stat issue by @tangledbytes in #8878
Replace mime with mime-types by @liranmauda in #8879
NC | LIFECYCLE | Add temporary NC_LIFECYCLE_GPFS_ILM_ENABLED configuration by @romayalon in #8877
CI | Data Buckets | Test AWS SDK Clients by @shirady in #8847
PublicAccessBlock Support by @tangledbytes in #8571
NC | lifecycle | add notifications for lifecycle expire by @nadavMiz in #8883
[NC | NSFS] Fix GPFS xattr read by @tangledbytes in #8880
bucket notification - move kafka options into object. Also add missing call to destroy() by @alphaprinz in #8889
CI | Update Ceph S3 Tests Days (Temporary Solution) by @shirady in #8892
Remove rimraf and refractor fs_utils.js by @liranmauda in #8887
Presigned URL | Add an Error on Expiry with a Negative Number by @shirady in #8873
NC | Lifecycle | Health by @romayalon in #8893
NC | lifecycle | expire objects with batching by @nadavMiz in #8897
Fixing issue with allowed methods by @jackyalbo in #8901
NC | generate_entropy Using lsblk Command by @shirady in #8777
IAM, STS | Improve Log Printing Before Throw Error of NotImplemented by @shirady in #8903
Added a fix for event handling of different errors by @achouhan09 in #8891
NC | Health | Connection test is invalid because of additional .json by @romayalon in #8910
bucket notifications - lifecycle - ignore failures (issue #8884) by @alphaprinz in #8886
Enhance Lifecycle support by @tangledbytes in #8888
bucket notifications - fixes for CompleteMultipartUploadResult etag and statusCode check by @alphaprinz in #8917
lifecycle | Versioned object doesn't leave a delete marker by @naveenpaul1 in #8899
NC | Online Upgrade CLI | Validate expected_version on upgrade start by @shirady in #8867
NC | lifecycle | fix notifications by @nadavMiz in #8913
Refactor | Remove deprecated pwhile from the code in favor of async/await by @liranmauda in #8922
Replace ncp with native fs/promises by @liranmauda in #8921
Bumping deps to avoid CVE (02/04/2025) by @liranmauda in #8926
NC | lifecycle | continue last run by @nadavMiz in #8925
NC | IAM | Return Empty List On Unimplemented Operations (list-group-for-user) by @shirady in #8920
Fixed a bug where we wrongly listed mime-type instead of mime-types by @liranmauda in #8933
nsfs - monitor only nsrs that are mounted. DFBUGS-153 by @alphaprinz in #8561
lifecycle | unit test for multipart, version and delete marker flow by @naveenpaul1 in #8885
NC | Lifecycle | Convert NCLifecycle to a class by @romayalon in #8929
NC | CLI | Update known issues doc with fixed version. by @naveenpaul1 in #8941
Added a fix for bucket lifecycle having tagging as an empty array in filter by @achouhan09 in #8940
Rejecting wildcard('*') in expose headers - like AWS by @jackyalbo in #8954
CI | Changed the job name of Jest Unit Tests by @liranmauda in #8959
NC | CLI | InvalidType Error | Replaced hard coded command types list with a dynamic list by @romayalon in #8952
Return Mock on GetBucketRequestPayment by @shirady in #8924
NC | NSFS | Fix the get_bucket_encryption to Return Object by @shirady in #8927
Added cnpg services to system_schema by @dannyzaken in #8966
bucket notification - align test notif structure by @alphaprinz in #8951
Add more validation for lifecycle by @tangledbytes in #8970
File Reader | Add next_line_file_offset by @romayalon in #8953
Added required validations in lifecycle rules by @achouhan09 in #8914
NC | CI | fix lifecycle timeout flaky test by @romayalon in #8971
NC | Lifecycle | GPFS ILM integration by @romayalon in #8923
NC | lifecycle | add newer noncurrent versions rule by @nadavMiz in #8949
NC | IAM | Return Empty List On Unimplemented List Operations by @shirady in #8977
NC | lifecycle | add expire delete marker rule by @nadavMiz in #8961
NC | NSFS | Add Concurrency Tests by @shirady in #8980
Rebase 5.19 from Master by @nimrod-becker in #9000
[backport into 5.19] bucket notifications - use node name in eventSource for NC (#8983) by @alphaprinz in #8986
Rebase master into 5.19 by @nimrod-becker in #9013
[Backport into 5.19] Bumping deps to avoid CVE (07/05/2025) by @liranmauda in #9015
[Backport 5.19] fix anonymous user access with PAB defined and fix PAB tests by @tangledbytes in #9021
[Backport 5.19] Fix lifecycle validations by @tangledbytes in #9020
Backport to 5.19 by @nimrod-becker in #9025
Backport to 5.19 by @nimrod-becker in #9032
[Backport to 5.19] Fixed async flow in nodes_monitor.js by @dannyzaken in #9035
5.19 | Backports by @romayalon in #9041
[Bakport to 5.19] in try_read_file_sync - treat ENOTDIR as ENOENT by @dannyzaken in #9046
[Backport into 5.19] fix diagnose connections by @alphaprinz in #9049
[Backport into 5.19] NC | LIFECYLE | GPFS | add external binary directory and --allow-scan… by @liranmauda in #9065
[Backport into 5.19] Bumping deps to avoid CVE (10/06/2025) by @liranmauda in #9075
[Backport 5.19] PR 9043 - add support for uls deletion by @tangledbytes in #9086
5.19 Backports | NC by @romayalon in #9102
[Backport into 5.19] dfs 2834, PR 9111 by @alphaprinz in #9114
5.19 Backport | NC by @romayalon in #9118
[Backport into 5.19] Bumping deps to avoid CVE (02/07/2025) by @liranmauda in #9132

Full Changelog: v5.18.0...v5.19.0

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

v5.19.0

What's Changed

Contributors

Uh oh!