"no more processes" when using su

IRIX and IRIX software discussion including open source and commerical offerings.
Forum rules
Any posts concerning pirated software or offering to buy/sell/trade commercial software are subject to removal.
User avatar
Bluefan
Posts: 586
Joined: Mon Oct 17, 2005 5:20 am
Location: Rekken, the Netherlands
Contact:

"no more processes" when using su

Unread postby Bluefan » Wed Aug 26, 2009 2:01 pm

I suddenly cannot become root anymore, among other problems:

Code: Select all

Toika 44% su
Password:
No more processes.
# ls
No more processes.
# exit
# exit
Toika 45%     


In the SYSLOG:

Code: Select all

Toika 45% tail /var/adm/SYSLOG
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd [10328804] - out of logical swap space during exec - see swap(1M) [filter /usr/sbin/syseventFilter failed: killed by signal 9]
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd[10324710] was killed; Dynamic Loader cannot map exe into memory
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd[10324710] was killed; Dynamic Loader cannot map exe into memory [filter /usr/sbin/syseventFilter failed: killed by signal 9]
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd [10324710] - out of logical swap space during exec - see swap(1M)
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd [10324710] - out of logical swap space during exec - see swap(1M) [filter /usr/sbin/syseventFilter failed: killed by signal 9]
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd[10323757] was killed; Dynamic Loader cannot map exe into memory
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd[10323757] was killed; Dynamic Loader cannot map exe into memory [filter /usr/sbin/syseventFilter failed: killed by signal 9]
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd [10323757] - out of logical swap space during exec - see swap(1M)
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd [10323757] - out of logical swap space during exec - see swap(1M) [filter /usr/sbin/syseventFilter failed: killed by signal 9]
Aug 26 22:53:13 1A:Toika unix: ALERT: syslogd[10350178] was killed; Dynamic Loader cannot map exe into memory


But is sure isn't out of memory:

Code: Select all

IRIX Toika 6.5 IP32            load averages: 0.93 0.85 0.61           22:54:03
57 processes:  56 sleeping, 1 running
CPU: 24.8% idle, 22.4% usr, 51.0% ker,  1.0% wait,  0.0% xbrk,  1.0% intr
Memory: 192M max, 166M avail, 21M free, 128M swap, 74M free swap

       PID       PGRP USERNAME PRI  SIZE   RES STATE    TIME WCPU% CPU% COMMAND
        75          0 root      20 1840K  232K sleep  892:47  8.5  8.35 syslogd
  10300129   10300129 johan     20 2328K 1012K run/0    0:00  1.8  1.52 top
  10178675   10229914 mysql     +8  611M   52M sleep  326:06  0.7  0.73 mysqld
       175        175 root      20 2404K  560K sleep   49:06  0.3  0.15 nsd
  10314448   10323180 johan     20 6648K 1764K sleep    0:01  0.1  0.08 sshd
       910        237 root      20 3016K  108K sleep   48:21  0.0  0.03 fam
       750        750 root      20   17M  400K sleep  152:55  0.0  0.03 httpd


Although the high pid seems strange. It sometimes even stopped working as a normal user replying the "no more processes", but that was only short.
Does anyone have an ideal what is going on here?
:O2:Toika :O2:Myra :O2:Fiona :Octane:Lisa :Octane:Sandra :Indigo2:Danica :Indy:Giana :O200:Lara :O200: :O200:Iona :O2000:Aida

User avatar
Bluefan
Posts: 586
Joined: Mon Oct 17, 2005 5:20 am
Location: Rekken, the Netherlands
Contact:

Re: "no more processes" when using su

Unread postby Bluefan » Thu Aug 27, 2009 3:43 am

Just an example of what goes wrong:

Code: Select all

Toika 7# nano
No more processes.
Toika 8# nano
10281656:nano: rld: Error: elfmap: couldn't map /usr/nekoware/lib/libiconv.so.3: (null)
10281656:nano: rld: Fatal Error: Cannot Successfully map soname 'libiconv.so.3' under any of the filenames /usr/nekoware/lib/libiconv.so.3:/usr/lib32/libiconv.so.3:/usr/lib32/internal/libiconv.so.3:/lib32/libiconv.so.3:/opt/lib32/libiconv.so.3:/usr/nekoware/lib/libiconv.so.3.3:/usr/lib32/libiconv.so.3.3:/usr/lib32/internal/libiconv.so.3.3:/lib32/libiconv.so.3.3:/opt/lib32/libiconv.so.3.3:

-----

Toika 12# cat
No more processes.
Toika 13# top
No more processes.
Toika 14# nano
No more processes.
Toika 15# whoami
No more processes.


My whole system is going weird. I'd like to fix this instead of just rebooting and waiting for it to happen again.
:O2:Toika :O2:Myra :O2:Fiona :Octane:Lisa :Octane:Sandra :Indigo2:Danica :Indy:Giana :O200:Lara :O200: :O200:Iona :O2000:Aida

User avatar
skywriter
Posts: 3290
Joined: Fri Mar 14, 2003 5:22 am
Location: Trump-proof bunker
Contact:

Re: "no more processes" when using su

Unread postby skywriter » Thu Aug 27, 2009 5:04 am

Bluefan wrote:My whole system is going weird. I'd like to fix this instead of just rebooting and waiting for it to happen again.


so two thoughts for you:
1) how can you fix the system without rebooting if you can't start a process?
2) the system run state probably so corrupt you can't trust anything anyway.

i doubt you can even shut the system down correctly.

sync
halt -p (or whatever unix thing it was)
:Skywriter:

DECUS Member 368596

SAQ
Posts: 5871
Joined: Wed Jul 19, 2006 8:37 am
Location: Renton, WA

Re: "no more processes" when using su

Unread postby SAQ » Thu Aug 27, 2009 11:52 am

Under normal circumstances UNIX is supposed to recycle PIDs - could you have a whole bunch of zombie processes somewhere? I'm not sure what could happen that would prevent PID reuse, but something funny might have happened there. Probably some random wierdness.

You might not even be able to bring it down using the shutdown, halt or telinit commands. You might need to bump the power switch - I think that works properly on O2 (i.e. leads to a nice shutdown).
"Brakes??? What Brakes???"

"I am O SH-- the Great and Powerful"

:Indigo: :Octane: :Indigo2: :Indigo2IMP: :Indy: :PI: :O3x0: :ChallengeL: :O2000R: (single-CM)

User avatar
porter
Posts: 2917
Joined: Wed Nov 01, 2006 10:37 pm
Location: NZ

Re: "no more processes" when using su

Unread postby porter » Thu Aug 27, 2009 2:18 pm

SAQ wrote:You might need to bump the power switch - I think that works properly on O2 (i.e. leads to a nice shutdown).


Not if it can't run the shutdown scripts.

"sync" is the most important thing to be able to do, but if you can't get to root you are out of luck. Can you see or hear disk activity?

Sounds like

Code: Select all

main()
{
    while (1) fork();
}


for which there is no recovery except the big red switch.
Land of the Long White Cloud and no Software Patents.

User avatar
Bluefan
Posts: 586
Joined: Mon Oct 17, 2005 5:20 am
Location: Rekken, the Netherlands
Contact:

Re: "no more processes" when using su

Unread postby Bluefan » Thu Aug 27, 2009 3:33 pm

I usually get lucky after a few tries and can start a proces, it's quite random. Reboot is an option, but that doesn't feel like fixing it. Anybody a suggestion what it could be?
:O2:Toika :O2:Myra :O2:Fiona :Octane:Lisa :Octane:Sandra :Indigo2:Danica :Indy:Giana :O200:Lara :O200: :O200:Iona :O2000:Aida

SAQ
Posts: 5871
Joined: Wed Jul 19, 2006 8:37 am
Location: Renton, WA

Re: "no more processes" when using su

Unread postby SAQ » Thu Aug 27, 2009 3:36 pm

Bluefan wrote:I usually get lucky after a few tries and can start a process, it's quite random. Reboot is an option, but that doesn't feel like fixing it. Anybody a suggestion what it could be?


So this is a recurring problem? Sounds like corrupted software somewhere.

If it's only happened once I'd put it down to temporary weirdness and move on.
"Brakes??? What Brakes???"

"I am O SH-- the Great and Powerful"

:Indigo: :Octane: :Indigo2: :Indigo2IMP: :Indy: :PI: :O3x0: :ChallengeL: :O2000R: (single-CM)

User avatar
porter
Posts: 2917
Joined: Wed Nov 01, 2006 10:37 pm
Location: NZ

Re: "no more processes" when using su

Unread postby porter » Thu Aug 27, 2009 4:09 pm

Bluefan wrote:Anybody a suggestion what it could be?


(a) what is disk activity like?
(b) if you can start one process, get a tail on the syslog.
Land of the Long White Cloud and no Software Patents.

User avatar
Bluefan
Posts: 586
Joined: Mon Oct 17, 2005 5:20 am
Location: Rekken, the Netherlands
Contact:

Re: "no more processes" when using su

Unread postby Bluefan » Fri Aug 28, 2009 5:49 am

It's the server in the house, I went to it but there was no disk activity. I did notice that the led was yellow instead of the usual green, doesn't look very good. It now doesn't even responds to pings, so I just rebooted it, it turned off with a single push of the power button.

I attached the last part of the syslog.
Attachments
SYSLOG_part.txt
last part of the syslog
(142.87 KiB) Downloaded 20 times
:O2:Toika :O2:Myra :O2:Fiona :Octane:Lisa :Octane:Sandra :Indigo2:Danica :Indy:Giana :O200:Lara :O200: :O200:Iona :O2000:Aida


Return to “IRIX and Software”

Who is online

Users browsing this forum: No registered users and 2 guests