kernel/rcu/update.c

49 #include "rcu.h"
67  * rcu_read_lock_held_common() - might we be in RCU-sched read-side critical section?
76  * RCU-sched read-side critical section.  In absence of
77  * CONFIG_DEBUG_LOCK_ALLOC, this assumes we are in an RCU-sched read-side
79  * of preemption (including disabling irqs) counts as an RCU-sched
81  * that required that they be called within an RCU-sched read-side
87  * Note that if the CPU is in the idle loop from an RCU point of view (ie:
90  * rcu_read_lock().  The reason for this is that RCU ignores CPUs that are
92  * so such a CPU is effectively never in an RCU read-side critical section
93  * regardless of what RCU primitives it invokes.  This state of affairs is
94  * required --- we need to keep an RCU-free window in idle where the CPU may
99  * Similarly, we avoid claiming an RCU read lock held if the current
134  * non-expedited counterparts?  Intended for use within RCU.  Note
160  * rcu_async_hurry - Make future async RCU callbacks not lazy.
173  * rcu_async_relax - Make future async RCU callbacks lazy.
188  * use within RCU.  Note that this function takes the rcu_expedited
200  * rcu_expedite_gp - Expedite future RCU grace periods
230  * Inform RCU of the end of the in-kernel boot sequence.
261 	pr_info("Running RCU synchronous self tests\n");  in rcu_test_sync_prims()
269  * Switch to run-time mode once RCU has fully initialized.
311 // Tell lockdep when RCU callbacks are being invoked.
325  * rcu_read_lock_held() - might we be in RCU read-side critical section?
327  * If CONFIG_DEBUG_LOCK_ALLOC is selected, returns nonzero iff in an RCU
329  * this assumes we are in an RCU read-side critical section unless it can
331  * require that they be called within an RCU read-side critical section.
342  * offline from an RCU perspective, so check for those as well.
355  * rcu_read_lock_bh_held() - might we be in RCU-bh read-side critical section?
361  * that require that they be called within an RCU read-side critical
367  * offline from an RCU perspective, so check for those as well.
403 	struct rcu_synchronize *rcu;  in wakeme_after_rcu()  local
405 	rcu = container_of(head, struct rcu_synchronize, head);  in wakeme_after_rcu()
406 	complete(&rcu->completion);  in wakeme_after_rcu()
556 // Suppress boot-time RCU CPU stall warnings and rcutorture writer stall
588 	pr_info("RCU test callback executed %d\n", rcu_self_test_counter);  in test_callback()
617 	pr_info("Running RCU self tests\n");  in rcu_early_boot_tests()