lxc-start: Device or resource busy - failed to remove previous cgroup

Serge E. Hallyn serue at us.ibm.com
Mon Jan 4 17:24:18 PST 2010


Quoting Dwight Schauer (dschauer at gmail.com):
> On Mon, Jan 4, 2010 at 12:02 PM, Serge E. Hallyn <serue at us.ibm.com> wrote:
> > Quoting Dwight Schauer (dschauer at gmail.com):
> >> On Mon, Jan 4, 2010 at 4:40 AM, Daniel Lezcano <daniel.lezcano at free.fr> wrote:
> >> > Did you check the file /cgroup/<name>/tasks is empty ? it's probably a dumb
> >> > question, but just in case :)
> >> >
> >>
> >> Ok, since this is easy enough to reproduce, I got it into this state again.
> >>
> >> $ cat /cgroup/arch64-1/tasks
> >> $
> >>
> >> it is empty
> >
> > And there are no subdirectories?  What does the output of
> >        ls -laFZ /cgroup/arch64-1 look like?
> >
> 
> well, tasks is empty.

tasks is empty, but there are subdirectories - 102, 26533, etc.
This looks like the dirtywork of the ns cgroup.  If each of those
subdirs is also empty then you can rmdir them, then rmdir /cgroup/arch64-1.

Or, use a release agent, which is what I do.

cat << EOF > /bin/remove_dead_cgroup.sh
#!/bin/sh
echo "Removing dead cgroup .$*." >> /var/log/cgroup
rmdir /cgroup/$* >> /var/log/cgroup 2>&1
echo "return value was $?" >> /var/log/cgroup
EOF
echo /bin/remove_dead_cgroup.sh > /cgroup/release_agent 
echo 1 > /cgroup/notify_on_release

> $ sudo ls -lRaFZ /cgroup/arch64-1
> /cgroup/arch64-1:
> total 0
> drwxr-xr-x 6 root root  ? 0 Jan  3 21:04 ./
> drwxr-xr-x 9 root root  ? 0 Jan  3 21:04 ../
> drwxr-xr-x 2 root users ? 0 Jan  3 21:05 102/
> drwxr-xr-x 2 root users ? 0 Jan  4 02:31 26533/
> drwxr-xr-x 2 root users ? 0 Jan  4 07:24 26627/
> drwxr-xr-x 2 root users ? 0 Jan  4 07:24 26668/
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpu.shares
> -r--r--r-- 1 root root  ? 0 Jan  3 21:04 cpuacct.stat
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuacct.usage
> -r--r--r-- 1 root root  ? 0 Jan  3 21:04 cpuacct.usage_percpu
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.cpu_exclusive
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.cpus
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.mem_exclusive
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.mem_hardwall
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.memory_migrate
> -r--r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.memory_pressure
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.memory_spread_page
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.memory_spread_slab
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.mems
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.sched_load_balance
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 cpuset.sched_relax_domain_level
> --w------- 1 root root  ? 0 Jan  3 21:04 devices.allow
> --w------- 1 root root  ? 0 Jan  3 21:04 devices.deny
> -r--r--r-- 1 root root  ? 0 Jan  3 21:04 devices.list
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 freezer.state
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 net_cls.classid
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 notify_on_release
> -rw-r--r-- 1 root root  ? 0 Jan  3 21:04 tasks
> 
> /cgroup/arch64-1/102:
> total 0
> drwxr-xr-x 2 root users ? 0 Jan  3 21:05 ./
> drwxr-xr-x 6 root root  ? 0 Jan  3 21:04 ../
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpu.shares
> -r--r--r-- 1 root users ? 0 Jan  3 21:05 cpuacct.stat
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuacct.usage
> -r--r--r-- 1 root users ? 0 Jan  3 21:05 cpuacct.usage_percpu
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.cpu_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.cpus
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.mem_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.mem_hardwall
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.memory_migrate
> -r--r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.memory_pressure
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.memory_spread_page
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.memory_spread_slab
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.mems
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.sched_load_balance
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 cpuset.sched_relax_domain_level
> --w------- 1 root users ? 0 Jan  3 21:05 devices.allow
> --w------- 1 root users ? 0 Jan  3 21:05 devices.deny
> -r--r--r-- 1 root users ? 0 Jan  3 21:05 devices.list
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 freezer.state
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 net_cls.classid
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 notify_on_release
> -rw-r--r-- 1 root users ? 0 Jan  3 21:05 tasks
> 
> /cgroup/arch64-1/26533:
> total 0
> drwxr-xr-x 2 root users ? 0 Jan  4 02:31 ./
> drwxr-xr-x 6 root root  ? 0 Jan  3 21:04 ../
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpu.shares
> -r--r--r-- 1 root users ? 0 Jan  4 02:31 cpuacct.stat
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuacct.usage
> -r--r--r-- 1 root users ? 0 Jan  4 02:31 cpuacct.usage_percpu
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.cpu_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.cpus
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.mem_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.mem_hardwall
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.memory_migrate
> -r--r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.memory_pressure
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.memory_spread_page
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.memory_spread_slab
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.mems
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.sched_load_balance
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 cpuset.sched_relax_domain_level
> --w------- 1 root users ? 0 Jan  4 02:31 devices.allow
> --w------- 1 root users ? 0 Jan  4 02:31 devices.deny
> -r--r--r-- 1 root users ? 0 Jan  4 02:31 devices.list
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 freezer.state
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 net_cls.classid
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 notify_on_release
> -rw-r--r-- 1 root users ? 0 Jan  4 02:31 tasks
> 
> /cgroup/arch64-1/26627:
> total 0
> drwxr-xr-x 2 root users ? 0 Jan  4 07:24 ./
> drwxr-xr-x 6 root root  ? 0 Jan  3 21:04 ../
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpu.shares
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.stat
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.usage
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.usage_percpu
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.cpu_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.cpus
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mem_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mem_hardwall
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_migrate
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_pressure
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_spread_page
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_spread_slab
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mems
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.sched_load_balance
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.sched_relax_domain_level
> --w------- 1 root users ? 0 Jan  4 07:24 devices.allow
> --w------- 1 root users ? 0 Jan  4 07:24 devices.deny
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 devices.list
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 freezer.state
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 net_cls.classid
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 notify_on_release
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 tasks
> 
> /cgroup/arch64-1/26668:
> total 0
> drwxr-xr-x 2 root users ? 0 Jan  4 07:24 ./
> drwxr-xr-x 6 root root  ? 0 Jan  3 21:04 ../
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpu.shares
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.stat
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.usage
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuacct.usage_percpu
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.cpu_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.cpus
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mem_exclusive
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mem_hardwall
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_migrate
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_pressure
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_spread_page
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.memory_spread_slab
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.mems
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.sched_load_balance
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 cpuset.sched_relax_domain_level
> --w------- 1 root users ? 0 Jan  4 07:24 devices.allow
> --w------- 1 root users ? 0 Jan  4 07:24 devices.deny
> -r--r--r-- 1 root users ? 0 Jan  4 07:24 devices.list
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 freezer.state
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 net_cls.classid
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 notify_on_release
> -rw-r--r-- 1 root users ? 0 Jan  4 07:24 tasks


More information about the Containers mailing list