- 15 Oct, 2007 40 commits
-
-
Dmitry Adamushko authored
p->sched_class->set_curr_task() has to be called before activate_task()/enqueue_task() in rt_mutex_setprio(), sched_setschedule() and sched_move_task() in order to set up 'cfs_rq->curr'. The logic of enqueueing depends on whether a task to be inserted is 'current' or not. Signed-off-by:
Dmitry Adamushko <dmitry.adamushko@gmail.com> Signed-off-by:
Ingo Molnar <mingo@elte.hu> Signed-off-by:
Peter Zijlstra <a.p.zijlstra@chello.nl> Reviewed-by:
Thomas Gleixner <tglx@linutronix.de>
-
Dmitry Adamushko authored
Fix a problem in the 'sched-group' patch for !CONFIG_FAIR_GROUP_SCHED. description: sched_setscheduler() { ... if (task_running()) p->sched_class->put_prev_entity(); [ this one sets up cfs_rq->curr to NULL ] ... if (task_running) p->sched_class->set_curr_task(); [ and this one is a _NOP_ (empty) for !CONFIG_FAIR_GROUP_SCHED ] As a result, the task continues to run with cfs_rq->curr == NULL... no crashes (due to checks for !NULL in place) but e.g. update_curr() effectively becomes a NOP... i.e. runtime statistics for this task is not accounted untill it's rescheduled anew. Signed-off-by: -
Srivatsa Vaddagiri authored
Add interface to control cpu bandwidth allocation to task-groups. (not yet configurable, due to missing CONFIG_CONTAINERS) Signed-off-by:
Srivatsa Vaddagiri <vatsa@linux.vnet.ibm.com> Signed-off-by:
Dhaval Giani <dhaval@linux.vnet.ibm.com> Signed-off-by:
-
Mike Galbraith authored
fix SMP migration latencies: the vruntimes of different CPUs are at incompatible offsets so they have to be fixed up when migrating a task across CPUs. Signed-off-by:
Mike Galbraith <efault@gmx.de> Signed-off-by:
-
Peter Zijlstra authored
Better min_vruntime tracking: update it every time 'curr' is updated - not just when a task is enqueued into the tree. Signed-off-by:
-
Ingo Molnar authored
sched.o gets smaller and faster if we compile it with -fomit-frame-pointers, so make this a config option. The cost is the loss of multi-depth wchan lookups - but SysRq-T is a sufficient replacement for them anyway, so their utility is much lower these days. the size difference is significant: text data bss dec hex filename 34005 3462 24 37491 9273 sched.o.before 33470 3462 24 36956 905c sched.o.after Signed-off-by:
-
Dmitry Adamushko authored
Better placement of #ifdef CONFIG_SCHEDSTAT block in dequeue_entity(). Signed-off-by:
-
Ingo Molnar authored
remove wait_runtime based fields and features, now that the CFS math has been changed over to the vruntime metric. Signed-off-by:
-
Ingo Molnar authored
remove the wait_runtime-limit fields and the code depending on it, now that the math has been changed over to rely on the vruntime metric. Signed-off-by:
-
Dmitry Adamushko authored
'struct load_stat' is redundant now so let's get rid of it. Signed-off-by:
-
Ingo Molnar authored
micro-optimization: update cfs_rq->exec_clock only if CONFIG_SCHED_DEBUG=y. Signed-off-by:
-
Ingo Molnar authored
add more vruntime statistics. Signed-off-by:
-
Peter Zijlstra authored
Handle vruntime overflow by centering the key space around min_vruntime. ( otherwise we could overflow 64-bit vruntime in a few days with SCHED_IDLE tasks - or in a few years with nice +19. ) Signed-off-by:
-
Peter Zijlstra authored
add support for tree based vruntime averages. Signed-off-by:
-
Ingo Molnar authored
remove SCHED_FEAT_SKIP_INITIAL - it was off by default and even when enabled it never made any real difference. Signed-off-by:
-
Ingo Molnar authored
debug se->vruntime fields. Signed-off-by:
-
Peter Zijlstra authored
clean up new task placement. Signed-off-by:
-
Ingo Molnar authored
increase wakeup granularity - we were overscheduling a bit. Signed-off-by:
-
Ingo Molnar authored
simplify the check_preempt() methods. Signed-off-by:
-
Peter Zijlstra authored
simplify adaptive latency. Signed-off-by:
-
Peter Zijlstra authored
add proper new task placement for the vruntime based math too. ( note: introduces a swap() macro, but the swap token is too widely used in the kernel namespace for a generic version to be added without changing non-scheduler code - so this cleanup will be done separately. ) Signed-off-by:
-
Ingo Molnar authored
optimize vruntime based scheduling. Signed-off-by:
-
Ingo Molnar authored
move sched_feat() definitions so that it can be used sooner by generic code too. Signed-off-by:
-
Ingo Molnar authored
introduce se->vruntime as a sum of weighted delta-exec's, and use that as the key into the tree. the idea to use absolute virtual time as the basic metric of scheduling has been first raised by William Lee Irwin, advanced by Tong Li and first prototyped by Roman Zippel in the "Really Fair Scheduler" (RFS) patchset. also see: http://lkml.org/lkml/2007/9/2/76 for a simpler variant of this patch. Signed-off-by:
-
Ingo Molnar authored
clean up calc_weighted() - we always use the normalized shift so it's not needed to pass that in. Also, push the non-nice0 branch into the function. Signed-off-by:
-
Ingo Molnar authored
speed up update_load_add/_sub() by not delaying the division - this reduces CPU pipeline dependencies. Signed-off-by:
-
Ingo Molnar authored
suggested by Roman Zippel: uninline __enqueue_entity() and __dequeue_entity(). this reduces code size: text data bss dec hex filename 25385 2386 16 27787 6c8b sched.o.before 25257 2386 16 27659 6c0b sched.o.after Signed-off-by: -
Peter Zijlstra authored
Peter Zijlstra suggested to simplify SCHED_FEAT_* checks via the sched_feat(x) macro. No code changed: text data bss dec hex filename 38895 3550 24 42469 a5e5 sched.o.before 38895 3550 24 42469 a5e5 sched.o.after Signed-off-by:
-
Ingo Molnar authored
cleanup: simplify cfs_rq_curr() methods - now that the cfs_rq->curr pointer is unconditionally present, remove the wrappers. kernel/sched.o: text data bss dec hex filename 11784 224 2012 14020 36c4 sched.o.before 11784 224 2012 14020 36c4 sched.o.after Signed-off-by: -
Ingo Molnar authored
Noticed by Roman Zippel: use cfs_rq->curr in the !group-scheduling case too. Small micro-optimization and cleanup effect: text data bss dec hex filename 36269 3482 24 39775 9b5f sched.o.before 36177 3486 24 39687 9b07 sched.o.after Signed-off-by:
-
Ingo Molnar authored
continued removal of precise CPU load calculations. Signed-off-by:
-
Ingo Molnar authored
CPU load calculations are statistical anyway, and there's little benefit from having it calculated on every scheduling event. So remove this code, it gets rid of a divide from the scheduler wakeup and context-switch fastpath. Signed-off-by:
-
Ingo Molnar authored
remove the stat_gran code - it was disabled by default and it causes unnecessary overhead. Signed-off-by:
-
Ingo Molnar authored
use constants if !CONFIG_SCHED_DEBUG. this speeds up the code and reduces code-size: text data bss dec hex filename 27464 3014 16 30494 771e sched.o.before 26929 3010 20 29959 7507 sched.o.after Signed-off-by: -
Ingo Molnar authored
use the same defaults on both UP and SMP. Signed-off-by:
-
Ingo Molnar authored
track the maximum amount of time a task has executed while the CPU load was at least 2x. (i.e. at least two nice-0 tasks were runnable) Signed-off-by:
-
Ingo Molnar authored
small kernel/sched_debug.c cleanup - break up multi-variable assignment. no code changed: text data bss dec hex filename 38869 3550 24 42443 a5cb sched.o.before 38869 3550 24 42443 a5cb sched.o.after Signed-off-by:
-
Matthias Kaehlcke authored
Use list_for_each_entry_safe() instead of list_for_each_safe() in __wake_up_common() Signed-off-by:
Matthias Kaehlcke <matthias.kaehlcke@gmail.com> Signed-off-by:
-
Ingo Molnar authored
to get full child-runs-first semantics make sure the parent is rescheduled. Signed-off-by:
-
Ingo Molnar authored
fix the sched_child_runs_first flag: always call into ->task_new() if we are on the same CPU, as SCHED_OTHER tasks depend on it for correct initial setup. Signed-off-by:
-
