`nodectl` fails to list nodes with custom firmware

Mixtile Blade 3 (Mixtile Cluster Box)
#1

(See `nodectl` fails to list nodes with custom firmware built from this repo · Issue #13 · mixtile-rockchip/mixtile-clusterbox-mt7620a-openwrt · GitHub)

Mixtile nodectl internally executes:

lspci | grep "^03\|^04\|^05\|^06"

And apparently the intended output is:

03:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
04:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
05:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
06:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)

However, with a custom build from the above repo of the BMC firmware which includes the full pciutils package (with pciids - but I don’t think that either are actually significant to the problem) the output instead reads:

# sudo lspci
00:00.0 PCI bridge: Ralink corp. Device 0801 (rev 01)
01:00.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:00.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:04.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:08.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:0c.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)

The miop kernel-module is loaded on the clusterbox and the blades have version 1.0.0 of the miop-control package installed, but it appears that only the PCIe Switches are being seen, not any PCIe Network devices behind(?) them.

With the old v1.0 BMC board, the PCIe Network interfaces of these same blades were correctly exposed.

From one of the blades:

mixtile@blade3:~$ dpkg -l | grep -i miop
ii  miop-control                                1.0.0                              arm64        miop-control TCP/IP over PCIe device driver.

mixtile@blade3:~$ lsmod
Module                  Size  Used by
miop_ep                16384  0
miop_ep_net            20480  0
pcie_ep_rk35           20480  0
miop_reg               16384  3 miop_ep_net,pcie_ep_rk35,miop_ep
miop_control           16384  0
bcmdhd               1380352  0

mixtile@blade3:~$ uname -a
Linux blade3 5.10.66 #127 SMP Mon Oct 30 14:11:23 CST 2023 aarch64 GNU/Linux

mixtile@blade3:~$ cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

mixtile@blade3:~$ lspci
0002:20:00.0 PCI bridge: Fuzhou Rockchip Electronics Co., Ltd Device 3588 (rev 01)
0002:21:00.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:22:03.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:22:07.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:23:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)
0002:24:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)

mixtile@blade3:~$ sudo dmesg | grep --colour -i -e miop -e mixtile 
[    0.701195] Machine model: Mixtile Blade 3 v1.0.1
[    0.715638] OF: reserved mem: initialized node miop_dma@0x0e000000, compatible id shared-dma-pool
[    3.106871] Hardware name: Mixtile Blade 3 v1.0.1 (DT)
[107868.307942] miop_control: loading out-of-tree module taints kernel.
[107868.308177] miop_control_init
[107868.339288] Mixtile TCP/IP over PCIe device driver registry
[107868.343934] pcie_ep_rk35: module license 'MIXTILE' taints kernel.
[107868.344544] Mixtile TCP/IP over PCIe device driver initializing
[107868.350332] Mixtile TCP/IP over PCIe endpoint netdevice driver initializing
[107868.357317] Mixtile TCP/IP over PCIe EP driver probe
[107868.364775] miop-ep fe150000.pcie: assigned reserved memory node miop_dma@0x0e000000
[107868.364829] miop-ep fe150000.pcie: Looking up vpcie3v3-supply from device tree
[107868.384251] miop-ep fe150000.pcie: PCIe Linking...0, LTSSM is 0x1
[107870.461811] miop-ep fe150000.pcie: PCIe Link up, LTSSM is 0x230011

From the BMC:

mixtile@ClusterBox:~$ lsmod | grep -ve nf[t_] -e [oe]hci -e usb
ch343                  23586  0 
fsl_mph_dr_of           3682  0 
gpio_button_hotplug     6738  0 
gpio_pca953x           13234 16 
i2c_dev                 4866  0 
i2c_smbus               1562  0 
leds_gpio               3058  0 
miop                   36914  0 
realtek                11954  0 
regmap_i2c              3005  1 gpio_pca953x

mixtile@ClusterBox:~$ modinfo miop
module:         /lib/modules/5.15.150/miop.ko
license:        GPL
depends:
name:           miop
vermagic:       5.15.150 mod_unload MIPS32_R2 32BIT
#2

From the provided logs, it can be seen that the relevant drivers of both devices are loaded, but the blade3 driver shows that the pcie connection is established, but the data communication related logs are not. You can use dmesg to view the BMC logs related to miop information to better locate the problem

#3

No mention of miop in the BMC dmesg output:

[    0.000000] Linux version 5.15.150 (mixtile@mixtile-clusterbox) (mipsel-openwrt-linux-musl-gcc (OpenWrt GCC 12.3.0 r23820-cc69ae60bb) 12.3.0, GNU ld (GNU Binutils) 2.40.0) #0 Wed Aug 7 00:56:17 2024
[    0.000000] Board has DDR2
[    0.000000] Analog PMU set to hw control
[    0.000000] Digital PMU set to hw control
[    0.000000] SoC Type: MediaTek MT7620A ver:2 eco:6
[    0.000000] printk: bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019650 (MIPS 24KEc)
[    0.000000] MIPS: machine is MC-CLUSTERBOX
[    0.000000] Initrd not found or empty - disabling initrd
[    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 bytes.
[    0.000000] Primary data cache 32kB, 4-way, PIPT, no aliases, linesize 32 bytes
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000000fffffff]
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 64960
[    0.000000] Kernel command line: console=ttyS0,115200 root=/dev/mmcblk0p2 rootwait rw rootfstype=squashfs,jffs2
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[    0.000000] Writing ErrCtl register=0000385d
[    0.000000] Readback ErrCtl register=0000385d
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 249984K/262144K available (6171K kernel code, 613K rwdata, 1320K rodata, 1232K init, 216K bss, 12160K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS: 256
[    0.000000] CPU Clock: 580MHz
[    0.000000] clocksource: systick: mask: 0xffff max_cycles: 0xffff, max_idle_ns: 583261500 ns
[    0.000000] systick: enable autosleep mode
[    0.000000] systick: running - mult: 214748, shift: 32
[    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6590553264 ns
[    0.000002] sched_clock: 32 bits at 290MHz, resolution 3ns, wraps every 7405115902ns
[    0.007697] Calibrating delay loop... 385.84 BogoMIPS (lpj=1929216)
[    0.073648] pid_max: default: 32768 minimum: 301
[    0.079306] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.086372] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.098974] devtmpfs: initialized
[    0.107978] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.117563] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[    0.124389] pinctrl core: initialized pinctrl subsystem
[    0.131560] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.418521] rt2880_gpio 10000600.gpio: registering 24 gpios
[    0.424022] rt2880_gpio 10000600.gpio: registering 24 irq handlers
[    0.430697] rt2880_gpio 10000638.gpio: registering 16 gpios
[    0.436169] rt2880_gpio 10000638.gpio: registering 16 irq handlers
[    0.442675] rt2880_gpio 10000660.gpio: registering 32 gpios
[    0.448152] rt2880_gpio 10000660.gpio: registering 32 irq handlers
[    0.454835] rt2880_gpio 10000688.gpio: registering 1 gpios
[    0.460224] rt2880_gpio 10000688.gpio: registering 1 irq handlers
[    0.467554] i2c-ralink 10000900.i2c: clock 100KHz, re-start support
[    0.475431] PCI host bridge to bus 0000:00
[    0.479372] pci_bus 0000:00: root bus resource [mem 0x20000000-0x2fffffff]
[    0.486104] pci_bus 0000:00: root bus resource [io  0x10160000-0x1016ffff]
[    0.492728] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[    0.500486] pci 0000:00:00.0: [1814:0801] type 01 class 0x060400
[    0.506276] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x7fffffff]
[    0.512362] pci 0000:00:00.0: reg 0x14: [mem 0x20000000-0x2000ffff]
[    0.518581] pci 0000:00:00.0: supports D1
[    0.522428] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[    0.530446] pci 0000:01:00.0: [1b21:2824] type 01 class 0x060400
[    0.536366] pci 0000:01:00.0: enabling Extended Tags
[    0.541249] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    0.547157] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[    0.563852] pci 0000:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.571893] pci 0000:02:00.0: [1b21:2824] type 01 class 0x060400
[    0.577764] pci 0000:02:00.0: enabling Extended Tags
[    0.582665] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    0.589231] pci 0000:02:04.0: [1b21:2824] type 01 class 0x060400
[    0.595152] pci 0000:02:04.0: enabling Extended Tags
[    0.600028] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[    0.606581] pci 0000:02:08.0: [1b21:2824] type 01 class 0x060400
[    0.612460] pci 0000:02:08.0: enabling Extended Tags
[    0.617382] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold
[    0.623917] pci 0000:02:0c.0: [1b21:2824] type 01 class 0x060400
[    0.629838] pci 0000:02:0c.0: enabling Extended Tags
[    0.634714] pci 0000:02:0c.0: PME# supported from D0 D3hot D3cold
[    0.642151] pci 0000:02:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.649899] pci 0000:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.657711] pci 0000:02:08.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.665444] pci 0000:02:0c.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[    0.675343] pci_bus 0000:03: busn_res: [bus 03-ff] end is updated to 03
[    0.683776] pci_bus 0000:04: busn_res: [bus 04-ff] end is updated to 04
[    0.692250] pci_bus 0000:05: busn_res: [bus 05-ff] end is updated to 05
[    0.700778] pci_bus 0000:06: busn_res: [bus 06-ff] end is updated to 06
[    0.707173] pci_bus 0000:02: busn_res: [bus 02-ff] end is updated to 06
[    0.713633] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 06
[    0.720016] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 06
[    0.726497] pci 0000:00:00.0: BAR 0: no space for [mem size 0x80000000]
[    0.732868] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x80000000]
[    0.739646] pci 0000:00:00.0: BAR 1: assigned [mem 0x20000000-0x2000ffff]
[    0.746235] pci 0000:02:00.0: PCI bridge to [bus 03]
[    0.751080] pci 0000:02:04.0: PCI bridge to [bus 04]
[    0.755880] pci 0000:02:08.0: PCI bridge to [bus 05]
[    0.760697] pci 0000:02:0c.0: PCI bridge to [bus 06]
[    0.765524] pci 0000:01:00.0: PCI bridge to [bus 02-06]
[    0.770586] pci 0000:00:00.0: PCI bridge to [bus 01-06]
[    0.776332] clocksource: Switched to clocksource systick
[    0.784315] NET: Registered PF_INET protocol family
[    0.789436] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.797625] tcp_listen_portaddr_hash hash table entries: 1024 (order: 0, 4096 bytes, linear)
[    0.805838] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.813375] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.820823] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[    0.827664] TCP: Hash tables configured (established 2048 bind 2048)
[    0.834016] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.840400] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.847563] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.853176] PCI: CLS 80 bytes, default 32
[    0.857353] rt-timer 10000100.timer: maximum frequency is 1220Hz
[    0.868604] workingset: timestamp_bits=14 max_order=16 bucket_order=2
[    0.884132] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.889852] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.903074] gpio-export gpio_export: 1 gpio(s) exported
[    0.908649] gpio-pwms gpio-pwms: get rpm labels successed
[    0.913847] gpio-pwms gpio-pwms: get gdesc successed
[    0.918747] gpio-pwms gpio-pwms: get rpm gpio irq successed
[    0.924112] gpio-pwms gpio-pwms: request irq successed
[    0.929137] gpio-pwms gpio-pwms: get rpm labels successed
[    0.934327] gpio-pwms gpio-pwms: get gdesc successed
[    0.939162] gpio-pwms gpio-pwms: get rpm gpio irq successed
[    0.944556] gpio-pwms gpio-pwms: request irq successed
[    0.949610] successed to request gpio
[    0.953096] successed to request rpm  gpio
[    0.957321] successed to request gpio
[    0.960817] successed to request rpm  gpio
[    0.965393] shpchp 0000:00:00.0: card - bus=0x0, slot = 0x0 irq=0
[    0.971420] shpchp 0000:01:00.0: card - bus=0x1, slot = 0x0 irq=4
[    0.977383] shpchp 0000:02:00.0: card - bus=0x2, slot = 0x0 irq=4
[    0.983307] shpchp 0000:02:04.0: card - bus=0x2, slot = 0x0 irq=4
[    0.989262] shpchp 0000:02:08.0: card - bus=0x2, slot = 0x0 irq=4
[    0.995185] shpchp 0000:02:0c.0: card - bus=0x2, slot = 0x0 irq=4
[    1.001230] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.017502] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
[    1.027892] printk: console [ttyS0] disabled
[    1.032116] 10000c00.uartlite: ttyS0 at MMIO 0x10000c00 (irq = 20, base_baud = 2500000) is a Palmchip BK-3103
[    1.041818] printk: console [ttyS0] enabled
[    1.050287] printk: bootconsole [early0] disabled
[    1.069137] spi spi0.0: force spi mode3
[    1.074353] spi-nor spi0.0: w25q128 (16384 Kbytes)
[    1.079431] 3 fixed-partitions partitions found on MTD device spi0.0
[    1.085967] OF: Bad cell count for /palmbus@10000000/spi@b00/flash@0/partitions
[    1.093503] OF: Bad cell count for /palmbus@10000000/spi@b00/flash@0/partitions
[    1.101558] Creating 3 MTD partitions on "spi0.0":
[    1.106539] 0x000000000000-0x000000030000 : "u-boot"
[    1.114838] 0x000000030000-0x000000040000 : "u-boot-env"
[    1.123231] 0x000000040000-0x000000050000 : "factory"
[    1.148218] gsw: ephy base address: 12
[    1.154915] gsw: setting port4 to ephy mode
[    1.170378] mtk_soc_eth 10100000.ethernet: generated random MAC address 36:ef:b9:a5:d1:7c
[    1.181256] mtk_soc_eth 10100000.ethernet: connected port 5 to PHY at mdio-bus:01 [uid=001cc916, driver=Generic PHY]
[    1.192448] mtk_soc_eth 10100000.ethernet: loaded mt7620 driver
[    1.199325] mtk_soc_eth 10100000.ethernet eth0: mediatek frame engine at 0xb0100000, irq 5
[    1.217536] rtc-hym8563 0-0051: registered as rtc0
[    1.223836] rtc-hym8563 0-0051: setting system clock to 2024-10-15T01:18:56 UTC (1728955136)
[    1.234462] rt2880_wdt 10000120.watchdog: Initialized
[    1.255827] NET: Registered PF_INET6 protocol family
[    1.265704] Segment Routing with IPv6
[    1.269639] In-situ OAM (IOAM) with IPv6
[    1.273848] NET: Registered PF_PACKET protocol family
[    1.279168] 8021q: 802.1Q VLAN Support v1.8
[    1.287432] Waiting for root device /dev/mmcblk0p2...
[    1.307954] mmc0: new high speed SDHC card at address 1388
[    1.321358] mmcblk0: mmc0:1388 MK    14.4 GiB 
[    1.328429]  mmcblk0: p1 p2 p3
[    1.344745] VFS: Mounted root (squashfs filesystem) readonly on device 179:2.
[    1.357680] devtmpfs: mounted
[    1.367820] Freeing unused kernel image (initmem) memory: 1232K
[    1.373923] This architecture does not have kernel memory protection.
[    1.380516] Run /sbin/init as init process
[    1.384694]   with arguments:
[    1.384700]     /sbin/init
[    1.384709]   with environment:
[    1.384715]     HOME=/
[    1.384721]     TERM=linux
[    1.907225] init: Console is alive
[    1.911449] init: - watchdog -
[    2.417583] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[    2.541317] usbcore: registered new interface driver usbfs
[    2.547118] usbcore: registered new interface driver hub
[    2.552714] usbcore: registered new device driver usb
[    2.563330] usbcore: registered new interface driver usb_ch343
[    2.569392] ch343: USB serial driver for ch342/ch343/ch344/ch347/ch9101/ch9102/ch9103/ch9104, etc.
[    2.578554] ch343: V1.5 On 2022.12
[    2.590194] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.601499] fsl-ehci: Freescale EHCI Host controller driver
[    2.609600] ehci-platform: EHCI generic platform driver
[    2.625681] phy phy-usbphy.0: remote usb device wakeup disabled
[    2.631757] phy phy-usbphy.0: UTMI 16bit 30MHz
[    2.636303] ehci-platform 101c0000.ehci: EHCI Host Controller
[    2.642201] ehci-platform 101c0000.ehci: new USB bus registered, assigned bus number 1
[    2.650447] ehci-platform 101c0000.ehci: irq 26, io mem 0x101c0000
[    2.667291] ehci-platform 101c0000.ehci: USB 2.0 started, EHCI 1.00
[    2.675406] hub 1-0:1.0: USB hub found
[    2.680359] hub 1-0:1.0: 1 port detected
[    2.693405] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    2.702705] ohci-platform: OHCI generic platform driver
[    2.708730] ohci-platform 101c1000.ohci: Generic Platform OHCI controller
[    2.715745] ohci-platform 101c1000.ohci: new USB bus registered, assigned bus number 2
[    2.724009] ohci-platform 101c1000.ohci: irq 26, io mem 0x101c1000
[    2.759122] hub 2-0:1.0: USB hub found
[    2.764039] hub 2-0:1.0: 1 port detected
[    2.777330] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[    2.789584] init: - preinit -
[    3.048613] usb 1-1: new high-speed USB device number 2 using ehci-platform
[    3.410796] usb_ch343 1-1:1.0: ttyCH343USB0: usb to uart device
[    3.433741] usb_ch343 1-1:1.2: ttyCH343USB1: usb to uart device
[    3.539331] usb_ch343 1-1:1.4: ttyCH343USB2: usb to uart device
[    3.555123] usb_ch343 1-1:1.6: ttyCH343USB3: usb to uart device
[    3.562686] random: procd: uninitialized urandom read (4 bytes read)
[    4.073430] random: jshn: uninitialized urandom read (4 bytes read)
[    4.279892] random: jshn: uninitialized urandom read (4 bytes read)
[    4.595046] random: jshn: uninitialized urandom read (4 bytes read)
[    4.693260] random: jshn: uninitialized urandom read (4 bytes read)
[    4.768524] random: jshn: uninitialized urandom read (4 bytes read)
[    5.204367] 8021q: adding VLAN 0 to HW filter on device eth0
[    6.172637] mount_root: loading kmods from internal overlay
[    6.211918] kmodloader: loading kernel modules from //etc/modules-boot.d/*
[    6.224502] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
[    6.605740] block: attempting to load /etc/config/fstab
[    6.615698] block: unable to load configuration (fstab: Entry not found)
[    6.623016] block: no usable configuration
[    6.628872] mount_root: unable to create loop device
[    6.635376] mount_root: no usable overlay filesystem found, using tmpfs overlay
[    6.656228] urandom-seed: Seed file not found (/etc/urandom.seed)
[    6.754331] procd: - early -
[    6.757754] procd: - watchdog -
[    7.538211] procd: - watchdog -
[    7.542306] procd: - ubus -
[    7.644956] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.653527] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.664888] random: ubusd: uninitialized urandom read (4 bytes read)
[    7.679389] procd: - init -
[    9.109477] kmodloader: loading kernel modules from /etc/modules.d/*
[    9.130297] i2c_dev: i2c /dev entries driver
[    9.146663] pca953x 0-0024: supply vcc not found, using dummy regulator
[    9.154035] pca953x 0-0024: using no AI
[    9.319033] kmodloader: done loading kernel modules from /etc/modules.d/*
[    9.916243] random: jshn: uninitialized urandom read (4 bytes read)
[   14.579280] random: crng init done
[   14.582815] random: 30 urandom warning(s) missed due to ratelimiting
[   47.063842] 8021q: adding VLAN 0 to HW filter on device eth0
[   47.105241] device eth0 entered promiscuous mode
[   47.125566] br-lan: port 1(eth0.1) entered blocking state
[   47.131229] br-lan: port 1(eth0.1) entered disabled state
[   47.137154] device eth0.1 entered promiscuous mode
[   49.189682] mtk_soc_eth 10100000.ethernet eth0: port 5 link up (1000Mbps/Full duplex)
[   49.252570] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   49.289577] br-lan: port 1(eth0.1) entered blocking state
[   49.295155] br-lan: port 1(eth0.1) entered forwarding state
[   49.301327] IPv6: ADDRCONF(NETDEV_CHANGE): eth0.2: link becomes ready
[   49.369492] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   54.683146] pci_bus 0000:03: busn_res: [bus 03] is released
[   54.689339] pci_bus 0000:04: busn_res: [bus 04] is released
[   54.695478] pci_bus 0000:05: busn_res: [bus 05] is released
[   54.701597] pci_bus 0000:06: busn_res: [bus 06] is released
[   54.707666] pci_bus 0000:02: busn_res: [bus 02-06] is released
[   54.714067] pci_bus 0000:01: busn_res: [bus 01-06] is released
[   54.866608] pci 0000:00:00.0: [1814:0801] type 01 class 0x060400
[   54.872900] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x7fffffff]
[   54.879638] pci 0000:00:00.0: reg 0x14: [mem 0x20000000-0x2000ffff]
[   54.886182] pci 0000:00:00.0: supports D1
[   54.890346] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[   54.899067] pci 0000:01:00.0: [1b21:2824] type 01 class 0x060400
[   54.905536] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[   54.911844] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[   54.930016] pci 0000:02:00.0: [1b21:2824] type 01 class 0x060400
[   54.936438] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[   54.943463] pci 0000:02:04.0: [1b21:2824] type 01 class 0x060400
[   54.949983] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[   54.956939] pci 0000:02:08.0: [1b21:2824] type 01 class 0x060400
[   54.963403] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold
[   54.970383] pci 0000:02:0c.0: [1b21:2824] type 01 class 0x060400
[   54.976993] pci 0000:02:0c.0: PME# supported from D0 D3hot D3cold
[   54.987682] pci_bus 0000:03: busn_res: [bus 03-06] end is updated to 03
[   54.997217] pci_bus 0000:04: busn_res: [bus 04-06] end is updated to 04
[   55.006334] pci_bus 0000:05: busn_res: [bus 05-06] end is updated to 05
[   55.015364] pci_bus 0000:06: busn_res: [bus 06] end is updated to 06
[   55.021935] pci_bus 0000:02: busn_res: [bus 02-06] end is updated to 06
[   55.028720] pci_bus 0000:01: busn_res: [bus 01-06] end is updated to 06
[   55.035581] pci 0000:00:00.0: BAR 0: no space for [mem size 0x80000000]
[   55.042378] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x80000000]
[   55.049523] pci 0000:00:00.0: BAR 1: assigned [mem 0x20000000-0x2000ffff]
[   55.056495] pci 0000:02:00.0: PCI bridge to [bus 03]
[   55.061626] pci 0000:02:04.0: PCI bridge to [bus 04]
[   55.066737] pci 0000:02:08.0: PCI bridge to [bus 05]
[   55.071860] pci 0000:02:0c.0: PCI bridge to [bus 06]
[   55.076971] pci 0000:01:00.0: PCI bridge to [bus 02-06]
[   55.082359] pci 0000:00:00.0: PCI bridge to [bus 01-06]
[   55.087848] shpchp 0000:00:00.0: card - bus=0x0, slot = 0x0 irq=0
[   55.094245] shpchp 0000:01:00.0: card - bus=0x1, slot = 0x0 irq=4
[   55.100647] shpchp 0000:02:00.0: card - bus=0x2, slot = 0x0 irq=4
[   55.107010] shpchp 0000:02:04.0: card - bus=0x2, slot = 0x0 irq=4
[   55.113417] shpchp 0000:02:08.0: card - bus=0x2, slot = 0x0 irq=4
[   55.119810] shpchp 0000:02:0c.0: card - bus=0x2, slot = 0x0 irq=4
[   55.811351] No source specified
#4

With the Ubuntu 24.04.2 image with built-in miop modules, nodectl list works again - so it appears not to be an issue with a customised build of the BMC firmware, but instead that the official Mixtile Debian 12 image lacks a miop driver (and it was unclear to me that nodectl list only works when a node is running with miop loaded, rather than simply being physically present or powered).

I’ve updated the github.com issue - it would be good to have whatever override is needed so that the “Mixtile Limited Blade 3” branding is maintained even if the full pciutils package is built-in to the BMC firmware image.

#5

Thank you for receiving your question, you are correct, currently Debian 12 system does not contain miop driver, so it can not be recognized normally. In addition to the github.com issue, I think it is caused by the change of the pci.ids file. We can confirm whether this file contains the device descriptor of 4586 b6f2