5.11 ghost current version #2

Open

wenhuizhang wants to merge 165 commits into

5.11-ghost-current

Commits on Jun 12, 2021

Commits on Jun 21, 2021

Commits on Jul 8, 2021

Apply latest KCLs (up through and including kcl/395125)
jackhumphries
committed

Commits on Aug 18, 2021

Commits on Aug 25, 2021

sched/ghost: add ghost_wake_agent_on_check()

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add bpf_ghost_wake_agent()

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add a BPF program to pick_next_task()

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add bpf_ghost_run_gtid()

Barret Rhoden
authored and
hannahyp
committed

Commits on Aug 31, 2021

Commits on Oct 23, 2021

sched: WARN if a deferred TASK_NEW is detected during msg delivery.

neelnatu
authored and
hannahyp
committed
sched: only call update_curr_ghost if a task is accumulating cputime.

neelnatu
authored and
hannahyp
committed
sched: Allow RTLA_ON_IDLE to be used when committing a txn that targets a remote CPU

jackhumphries
authored and
hannahyp
committed
sched/ghost: add run_flags to trace_sched_ghost_latched()

Barret Rhoden
authored and
hannahyp
committed

Commits on Nov 3, 2021

sched/ghost: add MSG_TASK_LATCHED

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add was_latched to TASK_PREEMPT

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add cpu_seqnum to messages with a cpu parameter

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add cpu_seqnum to struct ghost_txn

Barret Rhoden
authored and
hannahyp
committed

Commits on Nov 5, 2021

sched/ghost: add was_current to TASK_DEPARTED

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: Add ghOSt paper and talk links to the README

jackhumphries
authored and
hannahyp
committed

Commits on Dec 3, 2021

sched: actually treat 'txn->commit_flags' as flags.

neelnatu
authored and
hannahyp
committed
sched: move ALLOW_TASK_ONCPU to commit_flags

neelnatu
authored and
hannahyp
committed
sched: don't advertise a departing task as runnable.

neelnatu
authored and
hannahyp
committed
sched: convert ghost_switchto_disable sysctl to an enclave tunable
hannahyp
committed
sched: ALLOW_TASK_ONCPU is now in commit_flags

neelnatu
authored and
hannahyp
committed
sched: free queue memory when last reference is dropped.

neelnatu
authored and
hannahyp
committed
sched/ghost: use krefs with struct ghost_queue

Barret Rhoden
authored and
hannahyp
committed

Commits on Jan 10, 2022

sched: refactor ghost_commit_txn exit path

joshdon
authored and
hannahyp
committed
sched: add more control over agent barrier increment

joshdon
authored and
hannahyp
committed
sched: add flag to avoid agent preempting a latched task

joshdon
authored and
hannahyp
committed
sched/ghost: allow the agent to request DO_NOT_PREEMPT

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: do not use BPF-PNT's return value to mean RETRY_TASK

Barret Rhoden
authored and
hannahyp
committed

Commits on Jan 12, 2022

sched: convert ghost_wake_on_waker_cpu sysctl to an enclave tunable
hannahyp
committed
sched/ghost: allow BPF-PNT to tell the kernel to not idle a cpu

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: ensure BPF helper IDs are correct

Barret Rhoden
authored and
hannahyp
committed
sched: convert ghost_commit_at_tick sysctl to an enclave tunable
hannahyp
committed
sched/ghost: restrict ioctl to writable ctl FDs

Barret Rhoden
authored and
hannahyp
committed

Commits on Jan 14, 2022

sched: initialize status_word with correct gtid

neelnatu
authored and
hannahyp
committed
sched: allow queue association for a task currently without a 'dst_q'

neelnatu
authored and
hannahyp
committed
sched/ghost: remove unused bpf prog attach/detach

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: remove ctx from bpf helpers

Barret Rhoden
authored and
hannahyp
committed
sched: handle tasks moving into ghost while rq->lock is dropped in PNT.

neelnatu
authored and
hannahyp
committed
sched/ghost: refactor message sending for bpf_ghost_msg

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: refactor ghost_bpf_link()

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add BPF_PROG_TYPE_GHOST_MSG

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add agent_data to common 'runnable' messages

Barret Rhoden
authored and
hannahyp
committed

Commits on Jan 18, 2022

sched: fix typo in task_deliver_msg_departed()

neelnatu
authored and
hannahyp
committed
sched: prevent departed->new msg reordering.

neelnatu
authored and
hannahyp
committed
sched/ghost: fix TASK_DEPARTED race with validate_next_task()

joshdon
authored and
hannahyp
committed
sched/ghost: allow queue wakeup to be configured to empty

joshdon
authored and
hannahyp
committed

Commits on Jan 19, 2022

Commits on Mar 7, 2022

sched: get rid of usused GHOST_MAX_SW_REGIONS and sw_region_ids[]

neelnatu
authored and
hannahyp
committed
sched: add an empty include/linux/ghost.h

neelnatu
authored and
hannahyp
committed
sched: don't include ghost uapi header from <include/linux/sched.h>

neelnatu
authored and
hannahyp
committed
sched: move ghost status_word helper functions into the uapi header

neelnatu
authored and
hannahyp
committed
sched: get rid of unused 'ghost_run_gtid_on_check()'

neelnatu
authored and
hannahyp
committed
sched: add ghost_uapi.h

neelnatu
authored and
hannahyp
committed
sched: GHOST_CPU_DATA_REGION_SIZE is specific to an ABI

neelnatu
authored and
hannahyp
committed
sched: separate headers along the ABI boundaries.

neelnatu
authored and
hannahyp
committed
sched: embed ABI in the 'expected_attach_type' of ghost/bpf programs.

neelnatu
authored and
hannahyp
committed
sched: move contents of ghostfs.c into ghost.c

neelnatu
authored and
hannahyp
committed
sched: restrict symbols leaked into global scope from ghost.c

neelnatu
authored and
hannahyp
committed
sched: beginnings of ghost_abi

neelnatu
authored and
hannahyp
committed
sched: allow agent to select abi when creating an enclave

neelnatu
authored and
hannahyp
committed
sched: add "version" file to retrieve abi of an enclave.

neelnatu
authored and
hannahyp
committed
sched: move enclave cpu management into abi-independent code.

neelnatu
authored and
hannahyp
committed
sched: sync_group_cookie generation is abi independent.

neelnatu
authored and
hannahyp
committed
sched: add 'wait_for_rendezvous' handler to ghost_abi.

neelnatu
authored and
hannahyp
committed
sched: add 'pnt_prologue' callback to ghost_abi.

neelnatu
authored and
hannahyp
committed

Commits on Mar 9, 2022

sched: implement enclave_abi() properly.

neelnatu
authored and
hannahyp
committed
sched: split ghost bpf code along ABI dependent/independent lines.

neelnatu
authored and
hannahyp
committed
sched: add 'enclave_release' handler to ghost_abi

neelnatu
authored and
hannahyp
committed
sched: move ghost_fdget_enclave() in abi-independent code.

neelnatu
authored and
hannahyp
committed
sched: make setsched into ghost abi-independent

neelnatu
authored and
hannahyp
committed
sched: ghost_prepare_task_switch() is abi-dependent.

neelnatu
authored and
hannahyp
committed
sched: add 'cpu_idle' callback to 'ghost_abi'

neelnatu
authored and
hannahyp
committed
sched: pull ghost_cfs_added_load() into abi-independent code.

neelnatu
authored and
hannahyp
committed
sched: gtid allocation is independent of the ABI.

neelnatu
authored and
hannahyp
committed

Commits on Mar 14, 2022

sched: cache 'abi' in ghost_fdget_enclave()

neelnatu
authored and
hannahyp
committed
sched: ghost_copy_process_epilogue()

neelnatu
authored and
hannahyp
committed
sched: abi-specific ghost tick

neelnatu
authored and
hannahyp
committed
sched: initialize 'rq->ghost' in abi-independent code.

neelnatu
authored and
hannahyp
committed
sched: provide an abi-specific entrypoint for switchto

neelnatu
authored and
hannahyp
committed
sched: abi-specific entrypoint for setscheduler

neelnatu
authored and
hannahyp
committed
sched: add abi-specific entrypoint for sched_fork()

neelnatu
authored and
hannahyp
committed
sched: move is_agent() into sched.h (abi independent)

neelnatu
authored and
hannahyp
committed
sched: make some symbols in ghost.c static

neelnatu
authored and
hannahyp
committed
sched: abi-specific entrypoint to commit greedy transactions.

neelnatu
authored and
hannahyp
committed
sched: get rid of ghost uapi dependency in timerfd.c

neelnatu
authored and
hannahyp
committed

Commits on Mar 16, 2022

sched: add abi-specific callback from pick_next_ghost_agent

neelnatu
authored and
hannahyp
committed
sched: s/update_curr_ghost/_update_curr_ghost

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.update_curr

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.prio_changed

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.switched_to

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.switched_from

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.task_dead

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.dequeue_task

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.put_prev_task

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.enqueue_task

neelnatu
authored and
hannahyp
committed

Commits on Mar 17, 2022

sched: add abi-specific callback for sched_class.set_curr_task

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.task_tick

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.pick_next_task

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.check_preempt_curr

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.yield_task

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.select_task_rq

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.task_woken

neelnatu
authored and
hannahyp
committed
sched: add abi-specific callback for sched_class.set_cpus_allowed

neelnatu
authored and
hannahyp
committed
sched: move 'ghost_sched_class' into abi-independent code.

neelnatu
authored and
hannahyp
committed
sched: use an ioctl for ghost_run()

neelnatu
authored and
hannahyp
committed
sched: deprecate ghost syscall

neelnatu
authored and
hannahyp
committed
sched: include "kernfs-internal.h" from ghost.c

neelnatu
authored and
hannahyp
committed
sched: helper script to easily manage ghost abi snapshots.

neelnatu
authored and
hannahyp
committed
sched: simplify for_each_abi()

neelnatu
authored and
hannahyp
committed
sched: deprecate ghost_abi_ptr_t

neelnatu
authored and
hannahyp
committed
sched: add _ghost_resolve_enclave(rq, p) helper

neelnatu
authored and
hannahyp
committed

Commits on Mar 18, 2022

sched: Add GHOST_BPF macro to include/uapi/linux/bpf.h

jackhumphries
authored and
hannahyp
committed
sched/ghost: fix kernfs hang with ghost_run

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: fix never-exiting agents during destroy

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: merge unpublish_cpu and return_cpu

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: merge claim_cpu and publish_cpu

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: remove cpu_owner

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: check txn cpu is in an enclave

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add warnings to catch kernfs_mutex deadlocks

Barret Rhoden
authored and
hannahyp
committed
ghost: add extra parameter to ghost_timer_fd

joshdon
authored and
hannahyp
committed
sched: eliminate gratuitous diffs

neelnatu
authored and
hannahyp
committed
sched: fix arm64 build

neelnatu
authored and
hannahyp
committed
sched: relocate 'ghost_rq' to the end of 'struct rq'

neelnatu
authored and
hannahyp
committed

Commits on Jun 8, 2022

sched/ghost: allow lockless requests to resched prev

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add bpf_ghost_resched_cpu

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: fix bpf_helper enclave discovery

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: alphabetize ghostfs enclave dirtab

Barret Rhoden
authored and
hannahyp
committed
sched: return status directly in ghost_associate_queue()
hannahyp
committed
sched: poisoned rendezvous should not produce TASK_PREEMPT.

neelnatu
authored and
hannahyp
committed
sched: relax VM_BUG_ON check in _ghost_resolve_enclave()

neelnatu
authored and
hannahyp
committed
sched/ghost: use ghostfs to move tasks to an enclave

Barret Rhoden
authored and
hannahyp
committed

Commits on Jun 9, 2022

sched/ghost: move bpf_link guts into ABI-dependent code

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: split out bpf helper ID definitions

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: increase bpf magic numbers

Barret Rhoden
authored and
hannahyp
committed

Commits on Jun 16, 2022

BPF fixes
hannahyp
committed
sched/ghost: pass the "create" cmd buffer to the abi

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: set uid/gid when creating an enclave

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: always defer ghost_destroy_enclave to a CFS task

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: replace BPF_GHOST_SCHED_SKIP_TICK with deliver_ticks

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add ghost BPF bits to tools/ header

Barret Rhoden
authored and
hannahyp
committed

Commits on Jun 17, 2022

sched/ghost: add a ctl command to disable the ability to load bpf programs

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: make _ghost_commit_pending_txn() return void

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: move BPF-PNT to pnt-prologue

Barret Rhoden
authored and
hannahyp
committed

Commits on Jun 23, 2022

sched/ghost: remove stale comment

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: always use select_task_rq_ghost()

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: free status words for suppressed messages

Barret Rhoden
authored and
hannahyp
committed
sched/ghost: add ctl command to discover tasks

Barret Rhoden
authored and
hannahyp
committed

Commits on Jul 14, 2022

ghost: add #define GHOST_BPF to scripts/bpf_helpers_doc.py
hannahyp
committed