summaryrefslogtreecommitdiffstats
path: root/src/test/messenger (follow)
Commit message (Collapse)AuthorAgeFilesLines
* test/messenger/simple*: throw when fails to mallocKefu Chai2017-05-101-2/+3
| | | | | | | silences the warning of "Null pointer passed as an argument to a 'nonnull' parameter" from clang analyzer. Signed-off-by: Kefu Chai <kchai@redhat.com>
* cmake: do not link messenger tests against libosKefu Chai2017-05-091-4/+4
| | | | | | objectstore is not used by these tests. Signed-off-by: Kefu Chai <kchai@redhat.com>
* core: introduce DirectMessengerCasey Bodley2017-04-251-1/+0
| | | | | | | | | DirectMessenger provides an efficient mechanism to support in-process embedding of Ceph components (e.g., embedding of the Ceph OSD in storage targets such as NFSv4 or iSCSI targets). Signed-off-by: Casey Bodley <cbodley@redhat.com> Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
* common: convert ms_type option to SAFE_OPTIONliuchang08122017-03-222-2/+2
| | | | | | | We need to modify ms_type in unittest. That use SAFE_OPTION to declare ms_type is safer than pass `safe=false` to set_val. Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
* Merge pull request #13785 from liewegas/wip-cleanup-featuresSage Weil2017-03-084-4/+4
|\ | | | | | | | | msg: no need to pass supported features to Messenger::Policy ctor Reviewed-by: Haomai Wang <haomai@xsky.com>
| * msg/Messenger: drop useless 'supported' arg to Policy ctorSage Weil2017-03-034-4/+4
| | | | | | | | | | | | We always use CEPH_FEATURES_DEFAULT_SUPPORTED (= CEPH_FEATURES_ALL) here. Signed-off-by: Sage Weil <sage@redhat.com>
* | test: add override in test submoduleliuchang08122017-03-031-11/+11
|/ | | | Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
* cmake: turn libcommon into a shared libraryKefu Chai2017-01-101-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | prior to this change, libcommon is a convenient library which gets linked into librados, librbd and libcephfs and all ceph executables. this incurs some problems: - double dose of libcommon in memory space and HDD: waste of memory and disk space. - if an application links to two libraries including libcommon at the same time. take librados and libcephfs as an example, they could interfere with each other by changing the other guy's status. after this change, libcommon is tuned into a shared library and renamed to libceph-common. it will be installed into $prefix/lib/ceph, and packaged in librados2. ceph.spec.in,debian/librados2.install: package libceph-common in librados2. CMakeLists.txt: - do not link against libboost-* if not necessary. - s/common/ceph-common/g - install libceph-common into $prefix/lib/ceph - set rpath to $prefix/lib/ceph - link against ceph-common if an executable needs access to non public symbols in ceph. Signed-off-by: Kefu Chai <kchai@redhat.com>
* common,test: g_ceph_context->put() upon returnKefu Chai2016-11-243-6/+9
| | | | | | | | | | | | | | | | | | | | | prior to this change, global_init() could create a new CephContext and assign it to g_ceph_context. it's our responsibilty to release the CephContext explicitly using cct->put() before the application quits. but sometimes, we fail to do so. in this change, global_init() will return an intrusive_ptr<CephContext>, which calls `g_ceph_context->put()` in its dtor. this ensures that the CephContext is always destroyed before main() returns. so the log is flushed before _log_exp_length is destroyed. there are two cases where global_pre_init() is called directly. - ceph_conf.cc: g_ceph_context->put() will be called by an intrusive_ptr<> deleter. - rgw_main.cc: global_init() is called later on on the success code path, so it will be taken care of. Fixes: http://tracker.ceph.com/issues/17762 Signed-off-by: Kefu Chai <kchai@redhat.com>
* xio: build fixes (XioMessenger lacks features argument)Matt Benjamin2016-11-032-2/+4
| | | | | | | Applies the constructor signature change to the uses in xio_client and xio_server test programs. Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
* msg: make loopback Connection feature accurate all the timeSage Weil2016-10-102-2/+3
| | | | | | | | | | | | | In 626360aab05545ddacb0ac28e54a70e31fd5695d we made the OSD cluster loopback connection CEPH_FEATURES_ALL, but all other loopback connections got features == 0. I can't come up with any reason we wouldn't want those connections to have accurate feature bits, so let's just use CEPH_FEATURES_ALL for all of them. While we're here, make the cflags argument required. Signed-off-by: Sage Weil <sage@redhat.com>
* Merge pull request #10506 from wjwithagen/wip-wjw-clock-realtimeSage Weil2016-09-221-0/+2
|\ | | | | FreeBSD: Define CLOCK_REALTIME_COARSE in compat.h
| * messenger/simple_dispatcher.cc: include compat.h for CLOCK_REALTIME_COARSE ↵Willem Jan Withagen2016-08-231-0/+2
| | | | | | | | | | | | if not available Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
* | Merge pull request #9932 from ↵Sage Weil2016-09-191-1/+0
|\ \ | | | | | | | | | | | | | | | | | | stiopaa1/test_simple_dispatcher_removeUnusedVariable test/simple_dispatcher.cc: remove unused variable Reviewed-by: Sage Weil <sage@redhat.com>
| * | test/simple_dispatcher.cc: remove unused variableMichal Jarzabek2016-06-251-1/+0
| |/ | | | | | | Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
* | msg/simple: add ms_handle_refused callbackPiotr Dałek2016-09-132-0/+4
| | | | | | | | | | | | | | | | Added new callback (ms_handle_refused) to dispatchers. It is called once connection attempt fails with ECONNREFUSED. Also added dummy ms_handle_refused handlers across codebase. Signed-off-by: Piotr Dałek <git@predictor.org.pl>
* | remove autotoolsSage Weil2016-09-071-76/+0
|/ | | | Signed-off-by: Sage Weil <sage@redhat.com>
* msgr,xio: flexible Messenger::create configuration flagsVu Pham2016-06-012-2/+2
| | | | | | | | | | | | | | Widen Messenger::create and XioMessenger constructor to support per-Messenger instance creation parameters. This introduce a minimalist generic set of flags to describe the type of Messenger and its associated resources. We apply the usage of these flags to ceph-osd's "workhorse", "heartbeat" and "light" Messenger instances, ceph-mon and other ceph clients Messengers. Signed-off-by: Vu Pham <vu@mellanox.com>
* cmake: <UPPERCASED_NAME>_FOUND in Findxio.cmakeMatt Benjamin2016-05-031-2/+2
| | | | | | For uniformity, upcase all these variables. Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
* cmake: removed rdmacm & ibverbs parallel to PR#8637Ali Maredia2016-04-221-2/+2
| | | | Signed-off-by: Ali Maredia <amaredia@redhat.com>
* cmake: moved tests into test/messenger dirAli Maredia2016-04-151-0/+44
| | | | | | Added a CMakeLists.txt into test/messenger. Signed-off-by: Ali Maredia <amaredia@redhat.com>
* make ctors with one argument explicitDanny Al-Gaaf2016-01-292-2/+2
| | | | | | | Use explicit keyword for constructors with one argument to prevent implicit usage as conversion functions. Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
* xio: fix to work with commit 626360aaVu Pham2015-06-232-2/+2
| | | | | | | Fix xio to work with commit 626360aa "msg, ceph_osd: Support feature bits for all message type's local connection" Signed-off-by: Vu Pham <vu@mellanox.com>
* xio: sync to work with accellio v1.4Vu Pham2015-06-231-2/+2
| | | | | | latest master's HEAD - tag v1-4 Signed-off-by: Vu Pham <vu@mellanox.com>
* Merge remote-tracking branch 'gh/hammer'Sage Weil2015-03-191-1/+3
|\ | | | | | | | | | | | | | | Conflicts: PendingReleaseNotes src/Makefile.am src/gmock src/test/Makefile.am
| * Minor changes in other Makefile.am files to make them support the build ↵Boris Ranto2015-03-061-1/+3
| | | | | | | | refinement
* | doc: update doc with latest codeKefu Chai2015-02-241-1/+1
|/ | | | | | * also silence some warnings of doxygen Signed-off-by: Kefu Chai <kchai@redhat.com>
* Fix make check blockers.Matt Benjamin2015-01-141-1/+9
| | | | | | | | | | | | | | | | | | | Replace ceph-helpers.sh check for ms_nocrc with the new formula for this. Fixes make check for default build. Additionally, fix linkage of several unittests when building with --enable-xio. xio: add missing noinst headers The common/address_helper.h file was not mentioned, also msg/xio/XioSubmit.h. Fix for Message.cc compilation error when Xio disabled. Mention simple_dispatcher.h and xio_dispatcher.h in noinst_HEADERS. xio: require boost-regex. Make address_helper conditional on Xio. This carries over to simple_client/simple_server, for convenience. Signed-off-by: Matt Benjamin <matt@cohortfs.com>
* Accelio Autotools glue.Matt Benjamin2015-01-141-18/+22
| | | | | | Add Accelio to build process with --enable-xio is provided. Signed-off-by: Matt Benjamin <matt@cohortfs.com>
* Ceph Accelio/RDMA Transport (XioMessenger).Matt Benjamin2015-01-1410-0/+1179
XioMessenger implements a Ceph Messenger provider for Accelio, a high-performance messaging transport by Mellanox. Current Accelio is layered on ibverbs, and supports Infiniband, ROCE, and other RDMA transports. Future Accelio verions will support alternative transports (including TCP), and flexible transport selection. config: cluster_rdma drives messenger creation ceph_mds ceph_mon and ceph_osd use XioMessengers for cluster communication when cluster_rdma is set Move XioMessenger to msg/xio. This matches the other new Messenger locations. test: tests for tcp and xio messengers (Not tests only.) buffer: add subclass for xio buffers xio: convert to Connection::send_message interface config: -x, --xio as aliases for client_rdma ceph-fuse: create xio messenger if client_rdma Find XioMessenger.h and QueueStrategy.h in msg/xio. ceph-syn: create xio messenger if client_rdma librados: create xio messenger if client_rdma Find XioMessenger.h and QueueStrategy.h in msg/xio. Restore non-abort from Xio Mon integration. Fix xio_client send count, again. xio: must signal cond under mutex lock xio: dispatch strategies support ms_fast_dispatch xio: config variable xio_port_shift remove set_port_shift() from XioMessenger, and just use the value from the configuration xio: don't depend on g_ceph_context for dout XioMessenger now uses its own cct for all logging operations the accelio log function, however, still depends on a global CephContext. so we maintain an extra one, separate from g_ceph_context, in XioMessenger.cc that is initialized on first construction and a reference is held indefinitely script: cephfsnew to automate pool and fs creation Use new on_ow_msg_send_complete hook. Replaces on_msg_delivered for one-way message style. Prototype new xio_discon behavior. On shutdown, XioPortal threads should not exit before Accelio finalizes all sessions. Inline join_sessions, it needs sh_mtx held across wait loop. Fix assert on Cond::Signal. Adds Cond2. Avoid deadlock, xio_disconnect can deliver a session teardown event. Also Mutex2. (Note, Mutex2 and Cond2 are replaced by standard C++ downstream.) Restore SimpleDispatcher Timings. The simple_client/simple_server timings are based on a ping/pong of messages between the client and server, unlike those of the xio_client/server programs, which are one-way (so their corresponding 1-way bandwidth is appx. 2x what the test reports). We assert that the results are in general comparable, because in both setups, a fixed number of messages (def. 50) is maintained in flight. Wrap Accelio mempool in XioPool, add stats. To enable stat prints, set xio_trace_mempool. Currently, prints to stdout at each 64K messages sent or received. Restore _send_message(..). Fix merge errors in simple_client, simple_dispatcher. xio: fix for size in pool stats Add in/outbound msg counters to XioPoolStats. Pool stats are easier to read. Pool stats are easier to read, and if enabled, print on session teardown. This is a convenient time to view stats, and with a small Make pool stats counters atomic. Track requests using hook ctor/dtor. Lockless, portal thread provides atomicity. Adapt to recent changes on Accelio for_next * Accelio options now of opaque type * on_msg_err with extra direction param * RDMA behavior now governed by 2 new options XIO_OPTNAME_MAX_INLINE_DATA XIO_OPTNAME_MAX_INLINE_HEADER * Separated send and recv queue depth xio_messenger: Change xio optname queue depth msgs * Set 16k threshold to rdma buffers instead of send * Change xio optname for queue depth msgs XIO_OPTNAME_SND/RCV_QUEUE_DEPTH_MSGS xio_messenger: Protect Accelio queue depth. (Minimal send flow control.) The guard is per xio_connection, and considering batches. Increment happens only if xio_send_msg succeeded, decrement in on_ms_ow_send_complete and on_msg_error. Note that we don't need atomics because counters are touched only in the correct portal thread. Find XioMsg.h in msg/xio Find XioMessenger.h and QueueStrategy.h in msg/xio (tests). Adapt to 2 Accelio API changes. 1. xio_context_stop loop takes only 1 argument 2. xio_connect() now takes a structure argument, by reference Set CMP0046 iif CMake version >= 3 Move XioMessenger to msg/xio xio: fix for segfault on xio_connect() No more Mutex2, Cond2. xio: number of portal threads is configurable xio: only create additional portals on bind() xio: use QueueStrategy(1) as default xio: Messenger factory accepts ms_type "xio" xio: use ms_type instead of client,cluster_rdma removing the ability to configure the client and cluster networks separately in favor of a single global messenger type --xio is now a command-line alias for --ms_type xio all daemons now use the Messenger::create() factory function instead of conditionally creating XioMessengers the OSD and Monitor classes no longer need separate messengers to deal with both tcp/rdma clients xio: portal binding honors ms_bind_port_min,max xio: remove xio_port_shift port shifting is no longer necessary, because we won't create both tcp and xio messengers for the same service Use Accelio sglist helper macros. xio: make xio buffer unshareable xio: Nuke special_handling. Replace GENERIC with MON (requested by Sage). Signed-off-by: Casey Bodley <casey@cohortfs.com> Signed-off-by: Vu Pham <vu@mellanox.com> Signed-off-by: Matt Benjamin <matt@cohortfs.com>