summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* rgw: SAL drivers take `boost::asio::io_context`Adam C. Emerson2024-01-2418-62/+132
| | | | | | | `RadosDriver` needs it, and since SAL generally uses `optional_yield`, other stores are going to need it to implement that sensibly. Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
* ceph/async: `io_context_pool` constructor/start takes init functionAdam C. Emerson2024-01-241-1/+22
| | | | | | | | Add overloads of the constructor and `start` that take an init function, for setting up the thread before dropping into `io_context::run`. Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
* common/async: `io_context_pool` constructor takes int64_tAdam C. Emerson2024-01-241-1/+1
| | | | | | | | Just because this is what Ceph's config uses and it saves a narrowing conversion. If we want to set a max value on the thread count, we should do it in config. Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
* include/inline_memory.h: Add missing includes to fix buildAdam Emerson2024-01-241-2/+6
| | | | Signed-off-by: Adam Emerson <aemerson@redhat.com>
* Merge pull request #49462 from rzarzynski/wip-bug-53789Laura Flores2024-01-241-1/+1
|\ | | | | osdc: fix the ENOCONN normalization in Objecter::_linger_reconnect()
| * osdc: fix the ENOCONN normalization in Objecter::_linger_reconnect()Radoslaw Zarzynski2022-12-151-1/+1
| | | | | | | | | | | | | | Problem's description: https://tracker.ceph.com/issues/53789#note-12 Fixes: https://tracker.ceph.com/issues/53789 Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
* | Merge pull request #55219 from samarahu/rgw_asio_frontend_assertsCasey Bodley2024-01-241-0/+4
|\ \ | | | | | | | | | | | | rgw/asio: Add asserts to rgw_asio_frontend.cc Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
| * | rgw/asio: Add asserts to ensure asio isn't running during `run` andSamarah2024-01-171-0/+4
| | | | | | | | | | | | | | | | | | `stop` calls Signed-off-by: Samarah <samarah.uriarte@ibm.com>
* | | Merge pull request #55192 from dparmar18/fix_docstrings_ceph_test_caseGregory Farnum2024-01-241-4/+4
|\ \ \ | | | | | | | | qa: typo fixes in ceph_test_case docstrings
| * | | qa: typo fixes in ceph_test_case docstringsDhairya Parmar2024-01-161-4/+4
| | | | | | | | | | | | | | | | Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
* | | | Merge pull request #53320 from jzhu116-bloomberg/wip-62710Casey Bodley2024-01-2411-256/+739
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | rgw/multisite: maintain endpoints connectable status and retry the requests to them when appropriate Reviewed-by: Mark Kogan <mkogan@ibm.com>
| * | | | rgw/multisite: add multisite test cases with some rgw instances downJane Zhu2024-01-221-0/+191
| | | | | | | | | | | | | | | | | | | | Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
| * | | | rgw/multisite: maintain endpoints connectable status and retry the requests ↵Jane Zhu2024-01-1610-256/+548
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | to them when appropriate Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
* | | | | Merge pull request #54941 from samsungceph/vstart_network_v2Adam King2024-01-241-1/+1
|\ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | vstart: Pick only CIDR-formatted routes when cephadm enabled Reviewed-by: Adam King <adking@redhat.com>
| * | | | | vstart: Pick only CIDR-formatted routes when cephadm enableddaegon.yang2023-12-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When cephadm is enabled, the script for determining the public_network value from 'ip route list' output was previously capturing all routes associated with the specified IP. This included non-CIDR formatted entries such as specific IP routes (e.g., 8.8.8.8) and gateway addresses, leading to the selection of multiple, potentially irrelevant entries. This behavior resulted in an issue where vstart could not correctly identify the network, causing it to terminate unexpectedly. This commit adds a grep command to ensure only CIDR network formats are identified. Signed-off-by: daegon.yang <daegon.yang@samsung.com>
* | | | | | Merge pull request #53668 from mdw-at-linuxbox/wip-master-update-kmip-1Casey Bodley2024-01-241-0/+0
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | Update libkmip to pull in some portability changes. Reviewed-by: Casey Bodley <cbodley@redhat.com>
| * | | | | | Update libkmip submodule to pull in some portability changes.Marcus Watts2024-01-231-0/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Marcus Watts <mwatts@redhat.com>
* | | | | | | Merge pull request #55183 from galsalomon66/s3select_fixes_QE_bugsGal Salomon2024-01-231-0/+0
|\ \ \ \ \ \ \ | |/ / / / / / |/| | | | | | rgw/s3select: bug fixes per QE recent defects
| * | | | | | bug fixes per QE recent defectsgalsalomon662024-01-231-0/+0
| | |_|_|/ / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | update for the engine_version message s3select submodule Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
* | | | | | Merge pull request #55217 from ronen-fr/wip-rf-old-reservRonen Friedman2024-01-235-52/+200
|\ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | osd/scrub: check reservation replies for relevance Reviewed-by: Samuel Just <sjust@redhat.com>-
| * | | | | | osd/scrub: check reservation replies for relevanceRonen Friedman2024-01-235-52/+200
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Compare a token (nonce) carried in the reservation reply with the remembered token of the reservation request. If they don't match, the reply is stale and should be ignored (and logged). Fixes: https://tracker.ceph.com/issues/64052 Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
* | | | | | | Merge pull request #55067 from yaarith/telemetry-pool-flagsLaura Flores2024-01-233-0/+39
|\ \ \ \ \ \ \ | | | | | | | | | | | | | | | | mgr/telemetry: add pool flags
| * | | | | | | mgr/telemetry: add pool flagsYaarit Hatuka2024-01-053-0/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Pool flags can help us learn how certain features are being used, for example, the "crimson" flag implies a crimson cluster. We add a basic_pool_flags collection to the "basic" channel for this purpose. Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
* | | | | | | | Merge pull request #55240 from rosinL/wip-fix-64032Laura Flores2024-01-231-0/+8
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | install-deps: Force remove ceph-libboost* packages
| * | | | | | | | install-deps: Force remove ceph-libboost* packagesluo rixin2024-01-191-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | As `apt-get remove ceph-libboost*` show the error and cause the make check failed. `E: The package ceph-libboost1.79-dev needs to be reinstalled, but I can't find an archive for it.` The ceph-libboost* packages may be not removed, so use `dpkg` to force remove ceph-libboost*. Fixes: https://tracker.ceph.com/issues/64032 Signed-off-by: luo rixin <luorixin@huawei.com>
* | | | | | | | | Merge pull request #55278 from Himura2la/patch-2zdover232024-01-231-0/+1
|\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Docs: Specify correct fs type for mkfs on volume creation Reviewed-by: Zac Dover <zac.dover@proton.me> Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
| * | | | | | | | | doc: specify correct fs type for mkfsHimura Kazuto2024-01-231-0/+1
| | |_|/ / / / / / | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The default value is ext2, which is not supported (anymore?). Signed-off-by: Vladislav Glagolev <vladislav.glagolev@devexpress.com>
* | | | | | | | | Merge pull request #55277 from yuvalif/wip-yuval-63578Casey Bodley2024-01-231-1/+4
|\ \ \ \ \ \ \ \ \ | |/ / / / / / / / |/| | | | | | | | | | | | | | | | | | | | | | | | | | rgw/lua: fix compilation issue when lua packages are disabled Reviewed-by: Casey Bodley <cbodley@redhat.com>
| * | | | | | | | rgw/lua: fix compilation issue when lua packages are disabledYuval Lifshitz2024-01-231-1/+4
|/ / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes: https://tracker.ceph.com/issues/63578#change-253102 Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
* | | | | | | | Merge pull request #55107 from ronen-fr/wip-rf-rm-penaltyqRonen Friedman2024-01-2315-188/+238
|\ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | osd/scrub: remove the 'penalty queue' from the scrubber Reviewed-by: Samuel Just <sjust@redhat.com>-
| * | | | | | | | osd/scrub: update job's NB on failureRonen Friedman2024-01-2212-25/+170
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When a scrub job fails, update its NB to the current time plus a fixed delay. This prevents the job from being scheduled again immediately. Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
| * | | | | | | | osd/scrub: fix set_last_deep_scrub_stamp()Ronen Friedman2024-01-222-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The call should update last_scrub_stamp, too, without requiring an extra call to on_scrub_schedule_input_change() Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
| * | | | | | | | osd/scrub: introduce a 'not before' attribute for scrub jobsRonen Friedman2024-01-227-38/+68
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The NB enables the OSD to delay the next attempt to schedule a specific scrub job. This is useful for jobs that have failed for whatever reason, especially if the primary has failed to acquire the replicas. Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
| * | | | | | | | osd/scrub: remove the 'penalized jobs' queueRonen Friedman2024-01-225-139/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The 'penalized jobs' queue was used to track scrub jobs that had failed to acquire their replicas, and to prevent those jobs from being retried too quickly. This functionality will be replaced by a simple 'not before' delay (see the next commits). Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
* | | | | | | | | Merge pull request #55269 from ↵zdover232024-01-231-19/+30
|\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | zdover23/wip-doc-2024-01-23-radosgw-admin-read-write-global-rate-limit-config doc/radosgw: edit "read/write global rate limit" admin.rst Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
| * | | | | | | | | doc/radosgw: edit "read/write global rate limit" admin.rstZac Dover2024-01-231-19/+30
|/ / / / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Edit "Reading/Writing Global Rate Limit Configuration" in doc/radosgw/admin.rst. Signed-off-by: Zac Dover <zac.dover@proton.me>
* | | | | | | | | Merge pull request #55223 from athanatos/sjust/wip-64055Samuel Just2024-01-227-49/+191
|\ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | crimson: clear obc_registry on interval change Reviewed-by: Matan Breizman <mbreizma@redhat.com> Reviewed-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | crimson/osd/ops_executor: simplify prepare_clone, use set_clone_stateSamuel Just2024-01-202-29/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Remove static_snap_oi name -- left over from old classic implementation, misleading. - OpsExecutor::prepare_clone can only be invoked on a primary, remove the branch. - Create the obs directly and pass to obc via set_clone_state, which sets fully_loaded. Signed-off-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | crimson/osd: invalidate contents of obc_registry on interval_changeSamuel Just2024-01-203-3/+21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | We can't guarantee that all continuations will complete before on_flush, so we unhook and invalidate all live obcs from the registry upon interval_change. As long as any lingering continuations simply note the interval change and terminate, this should be safe. Signed-off-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | common/intrusive_lru: add clear() mechanism and state for removed items with ↵Samuel Just2024-01-182-9/+117
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | live references We need to be able to clear the lru without waiting for all outstanding references to be released. Items with such references enter an invalidated state where references can still be added and removed with deletion at use_count == 0, but can't be accessed any longer via the lru. Signed-off-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | common/intrusive_lru: generalize evict() slightly to allow other target valuesSamuel Just2024-01-181-5/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | common/intrusive_lru: clarify invariantsSamuel Just2024-01-181-9/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Samuel Just <sjust@redhat.com>
| * | | | | | | | | crimson/osd/object_context: rename ObjectContext::list_hook to ↵Xuehan Xu2024-01-171-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | obc_accessing_hook There's already a "list_hook" in the base class "intrusive_lru_base" Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
| * | | | | | | | | crimson/osd/object_context: assert that all in-cache obcs are fully loadedXuehan Xu2024-01-092-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
* | | | | | | | | | Merge pull request #55070 from pdvian/wip-fix-progresseventYuri Weinstein2024-01-221-1/+1
|\ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | mon: initialize ProgressEvent::add_to_ceph_s Reviewed-by: Laura Flores <lflores@redhat.com>
| * | | | | | | | | | mon: initialize ProgressEvent::add_to_ceph_sPrashant D2024-01-051-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The add_to_ceph_s field was not initialized causing unit test failures from check-generated.sh: **** ProgressEvent test 1 dump_json check failed **** ceph-dencoder type ProgressEvent select_test 1 dump_json > /tmp/typ-akwRrjNtt ceph-dencoder type ProgressEvent select_test 1 encode decode dump_json > /tmp/typ-iDmGaq17A 4c4 < "add_to_ceph_s": false --- > "add_to_ceph_s": true Fixes: https://tracker.ceph.com/issues/63950 Signed-off-by: Prashant D <pdhange@redhat.com>
* | | | | | | | | | | Merge pull request #53154 from ifed01/wip-ifed-no-death-testsYuri Weinstein2024-01-229-22/+65
|\ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | test/store_test: get rid off assert_death. Reviewed-by: Adam Kupczyk <akupczyk@redhat.com> Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
| * | | | | | | | | | | test/store_test: get rid off assert_death.Igor Fedotov2023-08-259-22/+65
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Looks like death assertions aren't 100% reliable and might cause deadlock sometimes. Hence getting rid of them and enabling optional sending exception from *Store::queue_transaction() Fixes: https://tracker.ceph.com/issues/61193 Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
* | | | | | | | | | | | Merge pull request #49415 from ljflores/wip-update-telemetry-upgradeYuri Weinstein2024-01-222-2/+4
|\ \ \ \ \ \ \ \ \ \ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | qa/workunits: update telemetry quincy workunits with `basic_pool_options_bluestore` collection Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
| * | | | | | | | | | | | qa/workunits: update telemetry quincy workunits with ↵Laura Flores2022-12-132-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | basic_pool_options_bluestore collection Signed-off-by: Laura Flores <ljflores@redhat.com>