thr3ads.net - freebsd stable - System totally borked after installworld and mergemaster at 16:20:03 MSK [May 2003]

If this information is useful, please help other people find it:
Share via:
Igor B. Bykhalo
2003-May-14 08:22 UTC
System totally borked after installworld and mergemaster at 16:20:03 MSK

Well, 4 days after previous upgrade i cvs'ed RELENG_4 from
local cvs tree (updated hourly), made buildworld buildkernel
installkernel, rebooted into single user, made installworld
and mergemaster.

Mergemaster updated newsyslog.conf, syslogd.conf, ok, rebooted...

Wow...
All scripts from /usr/local/etc/rc.d refused to load.
And the system is in "Amnesiac" mode

Attempt to run cvsupd.sh manually:
> Script started on Wed May 14 18:11:50 2003
> /bin/hostname: 1: Syntax error: word unexpected (expecting ")")
> # /bin/sh /usr/local/etc/rc.d/oops.sh start
> expr: 41: Syntax error: ")" unexpected
> /usr/local/etc/rc.d/oops.sh: Cannot determine the PREFIX
> # exit
> exit
>
> Script done on Wed May 14 18:12:24 2003
More fun:
> Script started on Wed May 14 18:05:58 2003
> > su
> Password:
> /bin/hostname: 1: Syntax error: word unexpected (expecting ")")
> # uname -a
> FreeBSD  4.8-STABLE FreeBSD 4.8-STABLE #49: Wed May 14 16:25:03 MSD 2003 \
> goshik@goshik.binep.ac.ru:/usr/obj/usr/src/sys/GO  i386
> # ps
> /bin/ps: Exec format error. Wrong Architecture.
> # pwd
> usage: kill [-s signal_name] pid ...
>        kill -l [exit_status]
>        kill -signal_name pid ...
>        kill -signal_number pid ...
Huh?!!
> # exit
> exit
> > exit
> exit
>
> Script done on Wed May 14 18:06:41 2003

Attempt to run buildworld:
> Script started on Wed May 14 18:13:32 2003
> /bin/hostname: 1: Syntax error: word unexpected (expecting ")")
> # cd /usr/src
> # make buildworld
>
> --------------------------------------------------------------
> >>> Rebuilding the temporary build tree
> --------------------------------------------------------------
> rm -rf /usr/obj/usr/src/i386
> mkdir -p /usr/obj/usr/src/i386/usr/bin
> docproj-1.11: not found
What? Why system tries to find docproj?
> @comment: not found
> 1: not found
> @name: not found
> @comment: not found
> @cwd: not found
> /bin/mkdir: man/man8/apple_driver.8.gz: not found
> @comment: not found
> /bin/mkdir: man/man8/isoinfo.8.gz: not found
> @comment: not found
> /bin/mkdir: man/man8/mkhybrid.8.gz: not found
> @comment: not found
> /bin/mkdir: man/man8/mkisofs.8.gz: not found
> @comment: not found
> @unexec: not found
> @unexec: not found
> @unexec: not found
> @unexec: not found
> /bin/mkdir: bin/devdump: not found
> @comment: not found
> /bin/mkdir: bin/isodump: not found
> @comment: not found
> /bin/mkdir: bin/isoinfo: not found
> @comment: not found
> /bin/mkdir: bin/isovfy: not found
> @comment: not found
> /bin/mkdir: bin/mkhybrid: not found
> @comment: not found
> /bin/mkdir: bin/mkisofs: not found
> @comment: not found
> @unexec: not found
> ised: not found
> rm: %D/info/dir: No such file or directory
> /bin/mkdir: 31: Syntax error: ";" unexpected
> *** Error code 2
>
> Stop in /usr/src.
> *** Error code 1
>
> Stop in /usr/src.
> # exit
> exit
>
> Script done on Wed May 14 18:13:55 2003
>
I'm srewed and out of ideas... Please, anyone has ideas
what's going on?

TIA,
Igor

Below are corresponding parts of /var/log/messages
an /var/log/console.log

***/var/log/messages***
May 14 17:56:43  /kernel: Copyright (c) 1992-2003 The FreeBSD Project.
May 14 17:56:43  /kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989,
1991, 1992, 1993, 1994
May 14 17:56:43  /kernel: The Regents of the University of California. All
rights reserved.
May 14 17:56:43  /kernel: FreeBSD 4.8-STABLE #49: Wed May 14 16:25:03 MSD 2003
May 14 17:56:43  /kernel: goshik@goshik.binep.ac.ru:/usr/obj/usr/src/sys/GO
May 14 17:56:43  /kernel: Timecounter "i8254"  frequency 1193117 Hz
May 14 17:56:43  /kernel: CPU: AMD Athlon(tm) XP 1500+ (1334.89-MHz 686-class
CPU)
May 14 17:56:43  /kernel: Origin = "AuthenticAMD"  Id = 0x662 
Stepping = 2
May 14 17:56:43  /kernel:
Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
May 14 17:56:43  /kernel: AMD Features=0xc0480000<MP,AMIE,DSP,3DNow!>
May 14 17:56:43  /kernel: real memory  = 268369920 (262080K bytes)
May 14 17:56:43  /kernel: config> en apm0
May 14 17:56:43  /kernel: config> di psm0
May 14 17:56:43  /kernel: config> di ppc0
May 14 17:56:43  /kernel: config> q
May 14 17:56:43  /kernel: avail memory = 258048000 (252000K bytes)
May 14 17:56:43  /kernel: Preloaded elf kernel "kernel" at 0xc0311000.
May 14 17:56:43  /kernel: Preloaded userconfig_script
"/boot/kernel.conf" at 0xc031109c.
May 14 17:56:43  /kernel: Preloaded elf module "vesa.ko" at
0xc03110ec.
May 14 17:56:43  /kernel: Preloaded elf module "vn.ko" at 0xc0311188.
May 14 17:56:43  /kernel: Preloaded elf module "if_ef.ko" at
0xc0311224.
May 14 17:56:43  /kernel: Preloaded elf module "if_sis.ko" at
0xc03112c4.
May 14 17:56:43  /kernel: Preloaded elf module "miibus.ko" at
0xc0311364.
May 14 17:56:43  /kernel: Preloaded elf module "snd_via8233.ko" at
0xc0311404.
May 14 17:56:43  /kernel: Preloaded elf module "snd_pcm.ko" at
0xc03114a8.
May 14 17:56:43  /kernel: Preloaded elf module "snp.ko" at 0xc0311548.
May 14 17:56:43  /kernel: VESA: v2.0, 4096k memory, flags:0x1, mode
table:0xc00c0b8b (c0000b8b)
May 14 17:56:43  /kernel: VESA: S3 Incorporated. 86C362
May 14 17:56:43  /kernel: Pentium Pro MTRR support enabled
May 14 17:56:43  /kernel: Using $PIR table, 7 entries at 0xc00fdea0
May 14 17:56:43  /kernel: apm0: <APM BIOS> on motherboard
May 14 17:56:43  /kernel: apm0: found APM BIOS v1.2, connected at v1.2
May 14 17:56:43  /kernel: npx0: <math processor> on motherboard
May 14 17:56:43  /kernel: npx0: INT 16 interface
May 14 17:56:43  /kernel: pcib0: <Host to PCI bridge> on motherboard
May 14 17:56:43  /kernel: pci0: <PCI bus> on pcib0
May 14 17:56:43  /kernel: pcib1: <PCI to PCI bridge (vendor=1106
device=b099)> at device 1.0 on pci0
May 14 17:56:43  /kernel: pci1: <PCI bus> on pcib1
May 14 17:56:43  /kernel: pci1: <S3 Trio3D/2X graphics accelerator> at 0.0
May 14 17:56:43  /kernel: sis0: <NatSemi DP83815 10/100BaseTX> port
0xd000-0xd0ff mem 0xed000000-0xed000fff irq 15 at device 9.0 on
pci0
May 14 17:56:43  /kernel: sis0: Ethernet address: 00:a0:cc:a1:c3:71
May 14 17:56:43  /kernel: miibus0: <MII bus> on sis0
May 14 17:56:43  /kernel: ukphy0: <Generic IEEE 802.3u media interface> on
miibus0
May 14 17:56:43  /kernel: ukphy0:  10baseT, 10baseT-FDX, 100baseTX,
100baseTX-FDX, auto
May 14 17:56:43  /kernel: viapropm0: SMBus I/O base at 0x5000
May 14 17:56:43  /kernel: viapropm0: <VIA VT8233 Power Management Unit>
port 0x5000-0x500f at device 17.0 on pci0
May 14 17:56:43  /kernel: viapropm0: SMBus revision code 0x0
May 14 17:56:43  /kernel: smb0: <SMBus general purpose I/O> on smbus0
May 14 17:56:43  /kernel: atapci0: <VIA 8233 ATA100 controller> port
0xd400-0xd40f at device 17.1 on pci0
May 14 17:56:43  /kernel: ata0: at 0x1f0 irq 14 on atapci0
May 14 17:56:43  /kernel: ata1: at 0x170 irq 15 on atapci0
May 14 17:56:43  /kernel: pci0: <VIA 83C572 USB controller> at 17.2 irq 12
May 14 17:56:43  /kernel: pci0: <VIA 83C572 USB controller> at 17.3 irq 12
May 14 17:56:43  /kernel: pcm0: <VIA VT8233> port 0xe400-0xe4ff irq 11 at
device 17.5 on pci0
May 14 17:56:43  /kernel: pcm0: <ICEnsemble ICE1232 ac97 codec>
May 14 17:56:43  /kernel: isa0: <ISA bus> on motherboard
May 14 17:56:43  /kernel: orm0: <Option ROM> at iomem 0xc0000-0xc7fff on
isa0
May 14 17:56:43  /kernel: fdc0: <NEC 72065B or clone> at port
0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
May 14 17:56:43  /kernel: fdc0: FIFO enabled, 8 bytes threshold
May 14 17:56:43  /kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0
May 14 17:56:43  /kernel: atkbdc0: <Keyboard controller (i8042)> at port
0x60,0x64 on isa0
May 14 17:56:43  /kernel: atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
May 14 17:56:43  /kernel: kbd0 at atkbd0
May 14 17:56:43  /kernel: vga0: <Generic ISA VGA> at port 0x3c0-0x3df
iomem 0xa0000-0xbffff on isa0
May 14 17:56:43  /kernel: sc0: <System console> at flags 0x100 on isa0
May 14 17:56:43  /kernel: sc0: VGA <16 virtual consoles, flags=0x300>
May 14 17:56:43  /kernel: sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
May 14 17:56:43  /kernel: sio0: type 16550A
May 14 17:56:43  /kernel: sio1 at port 0x2f8-0x2ff irq 3 on isa0
May 14 17:56:43  /kernel: sio1: type 16550A
May 14 17:56:43  /kernel: ncp_load: [210-213]
May 14 17:56:43  /kernel: ad0: 38166MB <WDC WD400EB-00CPF0> [77545/16/63]
at ata0-master UDMA100
May 14 17:56:43  /kernel: Mounting root from ufs:/dev/ad0s1a
May 14 17:56:43  savecore: no core dump
May 14 17:56:46  /kernel: uhci0: <VIA 83C572 USB controller> port
0xd800-0xd81f irq 12 at device 17.2 on pci0
May 14 17:56:47  /kernel: usb0: <VIA 83C572 USB controller> on uhci0
May 14 17:56:47  /kernel: usb0: USB revision 1.0
May 14 17:56:47  /kernel: uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00,
addr 1
May 14 17:56:47  /kernel: uhub0: 2 ports with 2 removable, self powered
May 14 17:56:47  /kernel: uhci1: <VIA 83C572 USB controller> port
0xdc00-0xdc1f irq 12 at device 17.3 on pci0
May 14 17:56:47  /kernel: usb1: <VIA 83C572 USB controller> on uhci1
May 14 17:56:47  /kernel: usb1: USB revision 1.0
May 14 17:56:47  /kernel: uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00,
addr 1
May 14 17:56:47  /kernel: uhub1: 2 ports with 2 removable, self powered
May 14 17:56:49  apmd[124]: start
***/var/log/messages***

***/var/log/console.log***
May 14 17:56:43  /kernel: dumpon: crash dumps to /dev/ad0s1b (116, 131073)
May 14 17:56:43  /kernel: swapon: adding /dev/ad0s1b as swap device
May 14 17:56:43  /kernel: Automatic boot in progress...
May 14 17:56:43  /kernel: /dev/ad0s1a:
May 14 17:56:43  /kernel: FILESYSTEM CLEAN; SKIPPING CHECKS
May 14 17:56:43  /kernel: /dev/ad0s1a:
May 14 17:56:43  /kernel: clean, 168366 free
May 14 17:56:43  /kernel: (678 frags, 20961 blocks, 0.3% fragmentation)
May 14 17:56:43  /kernel: /dev/ad0s1e:
May 14 17:56:43  /kernel: FILESYSTEM CLEAN; SKIPPING CHECKS
May 14 17:56:43  /kernel: /dev/ad0s1e:
May 14 17:56:43  /kernel: clean, 10303181 free
May 14 17:56:43  /kernel: (147885 frags, 1269412 blocks, 0.8% fragmentation)
May 14 17:56:43  /kernel: net.ipx.ipxnetbios:
May 14 17:56:43  /kernel: 0
May 14 17:56:43  /kernel: ->
May 14 17:56:43  /kernel: 1
May 14 17:56:43  /kernel:
May 14 17:56:43  /kernel: Doing initial network setup:
May 14 17:56:43  /kernel: hostname: 1: Syntax error: word unexpected (expecting
")")
May 14 17:56:43  /kernel: hostname: 1: Syntax error: word unexpected (expecting
")")
May 14 17:56:43  /kernel: hostname
May 14 17:56:43  /kernel: .
May 14 17:56:43  /kernel: sis0:
flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
May 14 17:56:43  /kernel: inet 193.233.44.235 netmask 0xffffffc0 broadcast
193.233.44.255
May 14 17:56:43  /kernel: inet 193.233.44.202 netmask 0xffffffff broadcast
193.233.44.202
May 14 17:56:43  /kernel: ether 00:a0:cc:a1:c3:71
May 14 17:56:43  /kernel: media: Ethernet autoselect (100baseTX
<full-duplex>)
May 14 17:56:43  /kernel: status: active
May 14 17:56:43  /kernel: sis0f0:
flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
May 14 17:56:43  /kernel: ipx bbbb0000.a0cca1c371
May 14 17:56:43  /kernel: ether 00:a0:cc:a1:c3:71
May 14 17:56:43  /kernel: lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST>
mtu 16384
May 14 17:56:43  /kernel: inet 127.0.0.1 netmask 0xff000000
May 14 17:56:43  /kernel: ipx aaaa0000.1H
May 14 17:56:43  /kernel: add net default: gateway 193.233.44.193
May 14 17:56:43  /kernel: Additional routing options:
May 14 17:56:43  /kernel: TCP keepalive=YES
May 14 17:56:43  /kernel: IPX gateway=YES
May 14 17:56:43  /kernel: .
May 14 17:56:43  /kernel: Routing daemons:
May 14 17:56:43  /kernel: IPXrouted
May 14 17:56:43  /kernel: .
May 14 17:56:43  /kernel: docproj-1.11: not found
                          ^^^^^^^?>>> And i've seen this above :-(
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: 1: not found
May 14 17:56:43  /kernel: @name: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: @cwd: not found
May 14 17:56:43  /kernel: mkdir: man/man8/apple_driver.8.gz: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: man/man8/isoinfo.8.gz: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: man/man8/mkhybrid.8.gz: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: man/man8/mkisofs.8.gz: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: @unexec: not found
May 14 17:56:43  last message repeated 3 times
May 14 17:56:43  /kernel: mkdir: bin/devdump: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: bin/isodump: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: bin/isoinfo: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: bin/isovfy: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: bin/mkhybrid: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: mkdir: bin/mkisofs: not found
May 14 17:56:43  /kernel: @comment: not found
May 14 17:56:43  /kernel: @unexec: not found
May 14 17:56:43  /kernel: ised: not found
May 14 17:56:43  /kernel: rm:
May 14 17:56:43  /kernel: %D/info/dir
May 14 17:56:43  /kernel: :
May 14 17:56:43  /kernel: No such file or directory
May 14 17:56:43  /kernel: mkdir: 31: Syntax error: ";" unexpected
May 14 17:56:43  /kernel: Additional daemons:
May 14 17:56:43  /kernel: syslogd
May 14 17:56:43  /kernel: .
May 14 17:56:43  /kernel: Checking for core dump:
May 14 17:56:43  /kernel: savecore: no core dump
May 14 17:56:43  /kernel: Doing additional network setup:
May 14 17:56:43  /kernel: ntpdate
May 14 17:56:45  /kernel: .
May 14 17:56:45  /kernel: Starting final network daemons:
May 14 17:56:45  /kernel: .
May 14 17:56:45  /kernel: Turning on accounting:
May 14 17:56:45  /kernel: ELF ldconfig path: /usr/lib /usr/lib/compat
/usr/X11R6/lib /usr/local/lib
May 14 17:56:46  /kernel: a.out ldconfig path: /usr/lib/aout
/usr/lib/compat/aout /usr/X11R6/lib/aout
May 14 17:56:46  /kernel: Starting standard daemons:
May 14 17:56:46  /kernel: inetd
May 14 17:56:46  /kernel: cron
May 14 17:56:46  /kernel: sshd
May 14 17:56:46  /kernel: usbd
May 14 17:56:48  /kernel: sendmail-submit
May 14 17:56:48  /kernel: sendmail-clientmqueue
May 14 17:56:48  /kernel: .
May 14 17:56:49  /kernel: Initial rc.i386 initialization:
May 14 17:56:49  /kernel: apm
May 14 17:56:49  /kernel: apmd
May 14 17:56:49  /kernel: .
May 14 17:56:49  /kernel: Configuring syscons:
May 14 17:56:49  /kernel: scrnmap
May 14 17:56:49  /kernel: font8x16
May 14 17:56:49  /kernel: font8x14
May 14 17:56:49  /kernel: font8x8
May 14 17:56:49  /kernel: blanktime
May 14 17:56:49  /kernel: allscreens
May 14 17:56:49  /kernel: .
May 14 17:56:49  /kernel: Additional ABI support:
May 14 17:56:49  /kernel: linux
May 14 17:56:50  /kernel: .
May 14 17:56:50  /kernel: Local package initialization:
May 14 17:56:51  /kernel: expr: 41: Syntax error: ")" unexpected
May 14 17:56:51  /kernel: /usr/local/etc/rc.d/cvsupd.sh: Cannot determine the
PREFIX
May 14 17:56:51  /kernel: expr: 41: Syntax error: ")" unexpected
May 14 17:56:51  /kernel: /usr/local/etc/rc.d/mathopd.sh: Cannot determine the
PREFIX
May 14 17:56:51  /kernel: expr: 41: Syntax error: ")" unexpected
May 14 17:56:51  /kernel: /usr/local/etc/rc.d/oops.sh: Cannot determine the
PREFIX
May 14 17:56:51  /kernel: .
May 14 17:56:51  /kernel: Additional TCP options:
May 14 17:56:51  /kernel: .
May 14 17:56:51  /kernel:
May 14 17:56:51  /kernel: Wed May 14 17:56:51 MSD 2003
May 14 17:57:24  /kernel: May 14 17:57:24  su: goshik to root on /dev/ttyv1
May 14 17:58:25  /kernel: May 14 17:58:25  su: goshik to root on /dev/ttyv2
May 14 18:00:00  newsyslog[206]: logfile turned over due to size>100K
***/var/log/console.log***
Possibly Parallel Threads

Search for more possibly parallel threads
freebsd stable - May 2003 - System totally borked after installworld and mergemaster at 16:20:03 MSK

System totally borked after installworld and mergemaster at 16:20:03 MSK

Possibly Parallel Threads

Wisdom of the Ancients
