Yes, after testing the new driver, there are no DMA timeout issues. Also, if no additional NVMe drive is connected, the iperf3 throughput is 16 Gbps; if an NVMe drive is connected, the speed is 10 Gbps
OK. I’ve still got two questions:
- Do I have to leave
/lib/miop/miop.koon the four nodes untouched? Themiop.ko, which comes with your zip file, seems to be made for the control board, right? - How do I unzip the zip file on the control board? OpenWRT seems not to come with the necessary
unziputility. Trying to get it, ends with such an error message:
mixtile@ClusterBox:~$ sudo opkg update
Downloading https://downloads.openwrt.org/releases/23.05-SNAPSHOT/targets/ramips/mt7620/packages/Packages.gz
*** Failed to download the package list from https://downloads.openwrt.org/releases/23.05-SNAPSHOT/targets/ramips/mt7620/packages/Packages.gz
[…]
mixtile@ClusterBox:~$ sudo opkg install unzip
Unknown package 'unzip'.
Collected errors:
* opkg_install_cmd: Cannot install package unzip.
Update: The transfer of the driver file did work via PC (unpack), Google Drive, and wget on the control board. Unfortunately, after replacing the file and rebooting (the nodes have already been updated and powered off), the nodes are no longer powered on! Even a manual nodectl poweron -n 1 ends in a segmentation fault. This is what the syslog says:
[ 40.652954] shpchp 0000:02:0c.0: card - bus=0x2, slot = 0x0 irq=4
[ 72.013184] export_store: invalid GPIO 499
[ 72.017829] do_page_fault(): sending SIGSEGV to nodectl for invalid read access from 0000004c
[ 72.026667] epc = 77dbe070 in libc.so[77d43000+ab000]
[ 72.031873] ra = 77dbe068 in libc.so[77d43000+ab000]
Did you follow my steps to replace the driver?
After replacing the driver on Blade 3, it must be powered off manually; it cannot be powered off through the control board. miop.ko is only for the control board.
You can try some recovery methods, such as removing Blade 3 separately, powering it on, and replacing the driver, or reflashing the latest firmware and then replacing it again.
If you are unable to replace it successfully, we expect to release a new firmware next week.
Yes, I have! In fact, I even made sure that the power LEDs on all four nodes were off before replacing the driver on the control board. Should I have removed the blades beforehand? You did not tell me to do that.
I’ve already tried that. No use. The problem must lie in the miop.ko code on the control board.
I’ve also done that. I’m glad that I made a backup of the control board just before replacing the driver, so that I could reset the board and then upload the backup. Unfortunately, the new (and presumably faulty) miop.ko is still there, so it was apparently not overwritten by the reset process:
mixtile@ClusterBox:~$ ls -al /lib/modules/5.15.150/miop.ko
-rw-r--r-- 1 root root 66090 May 17 17:01 /lib/modules/5.15.150/miop.ko
Shall I flash the board with the current firmware version from your website, or rather wait till you’ve got the new version ready? Please note that I originally wanted to put my cluster into productive use by the end of last week, so I’m losing time now.
And: Will the new image be based on the recent version of OpenWRT?
We have a 2025-year compiled OpenWrt, but we can’t find the image. We are compiling a new OpenWrt firmware, which will take 4 to 5 hours. Tomorrow we will provide you with the OpenWrt firmware link. And will fully verify it before sharing
So it’s version 24.10, right?
I’m not sure what version 24.10 refers to. Our available version is only OpenWrt 23.05.
We have already released the new firmware here:
24.10 was the stable version of OpenWRT by summer of 2025. By now (May 2026), 25.12.4 is the recent version. 23.05. has been declared end-of-life by its maintainers.
OK, I’ve just flashed the control board, as described by you. Unfortunately, I can’t install or update any software, as I get this error message:
Executing package manager
Downloading https://downloads.openwrt.org/releases/23.05-SNAPSHOT/targets/ramips/mt7620/packages/Packages.gz
*** Failed to download the package list from https://downloads.openwrt.org/releases/23.05-SNAPSHOT/targets/ramips/mt7620/packages/Packages.gz
Downloading https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/base/Packages.gz
*** Failed to download the package list from https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/base/Packages.gz
Downloading https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/luci/Packages.gz
*** Failed to download the package list from https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/luci/Packages.gz
Downloading https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/packages/Packages.gz
*** Failed to download the package list from https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/packages/Packages.gz
Errors
Collected errors:
* opkg_download: Failed to download https://downloads.openwrt.org/releases/23.05-SNAPSHOT/targets/ramips/mt7620/packages/Packages.gz, wget returned 8.
* opkg_download: Failed to download https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/base/Packages.gz, wget returned 8.
* opkg_download: Failed to download https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/luci/Packages.gz, wget returned 8.
* opkg_download: Failed to download https://downloads.openwrt.org/releases/23.05-SNAPSHOT/packages/mipsel_24kc/packages/Packages.gz, wget returned 8.
The opkg update command failed with code 4.
So your image still contains version 23.05 of OpenWRT, right? Where can I then get software for it? Do you have a repo I can use?
Neither does the internal network work correctly, as I can’t even ping the nodes from the control board:
mixtile@ClusterBox:~$ sudo ping blade3n1
PING blade3n1 (10.20.0.11): 56 data bytes
^C
--- blade3n1 ping statistics ---
10 packets transmitted, 0 packets received, 100% packet loss
BTW, I get some strange entries in the syslog I don’t know what they mean:
[ 492.385337] ------------[ cut here ]------------
[ 492.390090] WARNING: CPU: 0 PID: 0 at kernel/irq/manage.c:789 __enable_irq+0x5c/0x7c
[ 492.398037] Unbalanced enable for IRQ 4
[ 492.401948] Modules linked in: rt2800soc rt2800mmio rt2800lib pppoe ppp_async nft_fib_inet nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet rt2x00soc rt2x00mmio rt2x00lib pppox ppp_generic nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet nft_reject nft_redir nft_quota nft_objref nft_numgen nft_nat nft_masq nft_log nft_limit nft_hash nft_flow_offload nft_fib_ipv6 nft_fib_ipv4 nft_fib nft_ct nft_counter nft_chain_nat nf_tables nf_nat nf_flow_table nf_conntrack mt76x2e mt76x2_common mt76x02_lib mt76 mac80211 cfg80211 slhc nfnetlink nf_reject_ipv6 nf_reject_ipv4 nf_log_syslog nf_defrag_ipv6 nf_defrag_ipv4 miop(P) libcrc32c crc_ccitt compat i2c_smbus gpio_pca953x regmap_i2c i2c_dev ledtrig_usbport nls_utf8 nls_iso8859_1 nls_cp437 sha512_generic seqiv jitterentropy_rng drbg hmac cmac leds_gpio ohci_platform ohci_hcd fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd gpio_button_hotplug vfat fat ch343 usbcore nls_base usb_common realtek
[ 492.486642] CPU: 0 PID: 0 Comm: swapper Tainted: P 5.15.150 #0
[ 492.494111] Stack : 00000000 00000000 80c0bdc4 80940000 80780000 806c64e0 80784280 80783e03
[ 492.502680] 809433b4 00000000 0001544b 80061a48 806bfc08 00000001 80c0bd80 a1d45210
[ 492.511244] 00000000 00000000 806c64e0 80c0bc18 ffffefff 00000000 00000000 ffffffea
[ 492.519806] 00000000 80c0bc24 000001f1 8078a298 80940000 00000009 00000000 800651e4
[ 492.528370] 00000009 0001544b a6800000 00000000 00000018 803b4934 00a80017 00a80057
[ 492.536933] ...
[ 492.539432] Call Trace:
[ 492.541923] [<8000702c>] show_stack+0x28/0xf0
[ 492.546401] [<80026228>] __warn+0x9c/0x124
[ 492.550596] [<8002633c>] warn_slowpath_fmt+0x8c/0xac
[ 492.555668] [<800651e4>] __enable_irq+0x5c/0x7c
[ 492.560305]
[ 492.561822] ---[ end trace 54e9a0db4f3a4848 ]---
Update: I think I’ve hunted down the cause. It’s outdated ARP entries! The only problem is: I can’t remove them, as the ip neigh flush command thinks there is nothing to remove:
mixtile@ClusterBox:~$ arp
IP address HW type Flags HW address Mask Device
10.20.0.11 0x1 0x0 00:00:00:00:00:00 * pci0
10.20.0.14 0x1 0x0 00:00:00:00:00:00 * pci0
10.20.0.13 0x1 0x0 00:00:00:00:00:00 * pci0
10.20.0.12 0x1 0x0 00:00:00:00:00:00 * pci0
192.168.178.43 0x1 0x2 b4:2e:99:c6:e9:9f * eth0.2
192.168.178.1 0x1 0x2 34:81:c4:dd:78:f2 * eth0.2
mixtile@ClusterBox:~$ sudo ip neigh flush dev pci0
Nothing to flush
What shall I do now?
Didn’t you flash the new Blade3 image? Because this OpenWrt firmware must be used together with the Blade3 firmware released at the same time in order to work properly. We tested it and it works fine.
Fix repo command
sed -i 's/23.05-SNAPSHOT/23.05.5/g' /etc/opkg/distfeeds.conf
opkg update
Due to the limited performance of the SoC used on our control board, upgrading to a newer OpenWrt release may introduce instability or additional compatibility risks. For this reason, we have decided to keep the control board on the most stable system version that has been fully validated on our hardware.
@adam the blade3 firmware in the other thread is for desktop. Is there also one for Ubuntu server? Also, will this take me to a 6.1 kernel?
We don’t have an Ubuntu Server build yet; it will probably be available with the Ubuntu 26 release. If you only want to save resources by removing the desktop environment, you can uninstall ubuntu-desktop, gnome-shell, and gdm3 to get a system similar to Ubuntu Server. It uses the 6.1 kernel.
2 Likes
Sorry to tell you that even the newest firmware version for the control board has become useless to me, as the internal network often breaks down. I’m now even experiencing crashes as before the upgrade. I now get a presumably new error message, but in dnsmasq.log, not in the syslog:
May 26 18:18:14 dnsmasq[1]: warning: interface eth_pci does not currently exist
This error occurs because dnsmasq starts earlier than the PCI network interface appears.
In fact, I’m more suspicious that there may be some configuration issue, because all the Blade3 nodes were able to obtain IP addresses through DHCP.
Could you describe the network topology of your Cluster Box? Maybe I can reproduce this issue.
Yes, sure! The network topo of my cluster box is simple:
- Control board with eth0.2 (192.168.178.46; DHCP) attached to my SOHO router and, of course, the PCIe switch (10.20.0.1)
- 4 Blade nodes:
- blade3n1 (10.20.0.11; DHCP)
- blade3n2 (10.20.0.12; DHCP)
- blade3n3 (10.20.0.13; DHCP)
- blade3n4 (10.20.0.14; DHCP)
None of the external network and CAN bus ports of the Blade 3 nodes are attached. I once used them for a test, but this was months ago. DHCP and DNS for all nodes come from the control board, whereas the control board gets DNS from the router.
Update: I’ve already had cases where dnsmasq crashed mid-air and stopped translating hostnames during “normal” operation.
What if we only want to do static networking over the PCI network? We wouldn’t even need dnsmasq. I’m running into an issue now where the PCI device is not even visible:
Unknown error (DEVICE_CLAIM_FAILED).
Kernel log
[ 0.000000] Linux version 5.15.150 (root@runnervm9vjqi) (mipsel-openwrt-linux-musl-gcc (OpenWrt GCC 12.3.0 r0-f9f2e00) 12.3.0, GNU ld (GNU Binutils) 2.40.0) #0 Thu May 21 06:34:27 2026
[ 0.000000] Board has DDR2
[ 0.000000] Analog PMU set to hw control
[ 0.000000] Digital PMU set to hw control
[ 0.000000] SoC Type: MediaTek MT7620A ver:2 eco:6
[ 0.000000] printk: bootconsole [early0] enabled
[ 0.000000] CPU0 revision is: 00019650 (MIPS 24KEc)
[ 0.000000] MIPS: machine is MC-CLUSTERBOX
[ 0.000000] Initrd not found or empty - disabling initrd
[ 0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 bytes.
[ 0.000000] Primary data cache 32kB, 4-way, PIPT, no aliases, linesize 32 bytes
[ 0.000000] Zone ranges:
[ 0.000000] Normal [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000000fffffff]
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 64960
[ 0.000000] Kernel command line: console=ttyS0,115200 root=/dev/mmcblk0p2 rootwait rw rootfstype=squashfs,jffs2
[ 0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes, linear)
[ 0.000000] Writing ErrCtl register=00007fe3
[ 0.000000] Readback ErrCtl register=00007fe3
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] Memory: 249856K/262144K available (6307K kernel code, 614K rwdata, 1344K rodata, 1196K init, 216K bss, 12288K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] NR_IRQS: 256
[ 0.000000] CPU Clock: 580MHz
[ 0.000000] clocksource: systick: mask: 0xffff max_cycles: 0xffff, max_idle_ns: 583261500 ns
[ 0.000000] systick: enable autosleep mode
[ 0.000000] systick: running - mult: 214748, shift: 32
[ 0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 6590553264 ns
[ 0.000003] sched_clock: 32 bits at 290MHz, resolution 3ns, wraps every 7405115902ns
[ 0.007695] Calibrating delay loop... 385.84 BogoMIPS (lpj=1929216)
[ 0.073624] pid_max: default: 32768 minimum: 301
[ 0.079264] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.086325] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.104205] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.113745] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[ 0.120632] pinctrl core: initialized pinctrl subsystem
[ 0.127748] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 0.414383] rt2880_gpio 10000600.gpio: registering 24 gpios
[ 0.419825] rt2880_gpio 10000600.gpio: registering 24 irq handlers
[ 0.426401] rt2880_gpio 10000638.gpio: registering 16 gpios
[ 0.431813] rt2880_gpio 10000638.gpio: registering 16 irq handlers
[ 0.438256] rt2880_gpio 10000660.gpio: registering 32 gpios
[ 0.443667] rt2880_gpio 10000660.gpio: registering 32 irq handlers
[ 0.450145] rt2880_gpio 10000688.gpio: registering 1 gpios
[ 0.455469] rt2880_gpio 10000688.gpio: registering 1 irq handlers
[ 0.462741] i2c-ralink 10000900.i2c: clock 100KHz, re-start support
[ 0.470503] PCI host bridge to bus 0000:00
[ 0.474509] pci_bus 0000:00: root bus resource [mem 0x20000000-0x2fffffff]
[ 0.481132] pci_bus 0000:00: root bus resource [io 0x10160000-0x1016ffff]
[ 0.487816] pci_bus 0000:00: No busn resource found for root bus, will use [bus 00-ff]
[ 0.495610] pci 0000:00:00.0: [1814:0801] type 01 class 0x060400
[ 0.501421] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x7fffffff]
[ 0.507478] pci 0000:00:00.0: reg 0x14: [mem 0x2c400000-0x2c40ffff]
[ 0.513658] pci 0000:00:00.0: supports D1
[ 0.517485] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[ 0.525619] pci 0000:01:00.0: [1b21:2824] type 01 class 0x060400
[ 0.531499] pci 0000:01:00.0: enabling Extended Tags
[ 0.536410] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[ 0.542309] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 0.559007] pci 0000:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.567036] pci 0000:02:00.0: [1b21:2824] type 01 class 0x060400
[ 0.572904] pci 0000:02:00.0: enabling Extended Tags
[ 0.577805] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[ 0.584357] pci 0000:02:04.0: [1b21:2824] type 01 class 0x060400
[ 0.590280] pci 0000:02:04.0: enabling Extended Tags
[ 0.595160] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[ 0.601634] pci 0000:02:08.0: [1b21:2824] type 01 class 0x060400
[ 0.607507] pci 0000:02:08.0: enabling Extended Tags
[ 0.612419] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold
[ 0.618976] pci 0000:02:0c.0: [1b21:2824] type 01 class 0x060400
[ 0.624898] pci 0000:02:0c.0: enabling Extended Tags
[ 0.629783] pci 0000:02:0c.0: PME# supported from D0 D3hot D3cold
[ 0.637221] pci 0000:02:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.644969] pci 0000:02:04.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.652778] pci 0000:02:08.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.660512] pci 0000:02:0c.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.670333] pci_bus 0000:03: busn_res: [bus 03-ff] end is updated to 03
[ 0.678760] pci_bus 0000:04: busn_res: [bus 04-ff] end is updated to 04
[ 0.687243] pci_bus 0000:05: busn_res: [bus 05-ff] end is updated to 05
[ 0.695705] pci_bus 0000:06: busn_res: [bus 06-ff] end is updated to 06
[ 0.702096] pci_bus 0000:02: busn_res: [bus 02-ff] end is updated to 06
[ 0.708542] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 06
[ 0.714936] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to 06
[ 0.721414] pci 0000:00:00.0: BAR 0: no space for [mem size 0x80000000]
[ 0.727781] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x80000000]
[ 0.734555] pci 0000:00:00.0: BAR 1: assigned [mem 0x20000000-0x2000ffff]
[ 0.741146] pci 0000:02:00.0: PCI bridge to [bus 03]
[ 0.745989] pci 0000:02:04.0: PCI bridge to [bus 04]
[ 0.750794] pci 0000:02:08.0: PCI bridge to [bus 05]
[ 0.755610] pci 0000:02:0c.0: PCI bridge to [bus 06]
[ 0.760438] pci 0000:01:00.0: PCI bridge to [bus 02-06]
[ 0.765500] pci 0000:00:00.0: PCI bridge to [bus 01-06]
[ 0.771368] clocksource: Switched to clocksource systick
[ 0.778481] NET: Registered PF_INET protocol family
[ 0.783599] IP idents hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.791785] tcp_listen_portaddr_hash hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.799996] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.807522] TCP established hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.814975] TCP bind hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.821817] TCP: Hash tables configured (established 2048 bind 2048)
[ 0.828166] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.834550] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.841836] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 0.847480] PCI: CLS 80 bytes, default 32
[ 0.851668] rt-timer 10000100.timer: maximum frequency is 1220Hz
[ 0.862982] workingset: timestamp_bits=14 max_order=16 bucket_order=2
[ 0.878494] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 0.884196] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME) (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[ 0.897446] gpio-export gpio_export: 1 gpio(s) exported
[ 0.903024] gpio-pwms gpio-pwms: get rpm labels successed
[ 0.908223] gpio-pwms gpio-pwms: get gdesc successed
[ 0.913119] gpio-pwms gpio-pwms: get rpm gpio irq successed
[ 0.918507] gpio-pwms gpio-pwms: request irq successed
[ 0.923501] gpio-pwms gpio-pwms: get rpm labels successed
[ 0.928703] gpio-pwms gpio-pwms: get gdesc successed
[ 0.933531] gpio-pwms gpio-pwms: get rpm gpio irq successed
[ 0.938937] gpio-pwms gpio-pwms: request irq successed
[ 0.944062] successed to request gpio
[ 0.947554] successed to request rpm gpio
[ 0.951686] successed to request gpio
[ 0.955225] successed to request rpm gpio
[ 0.959710] shpchp 0000:00:00.0: card - bus=0x0, slot = 0x0 irq=0
[ 0.965738] shpchp 0000:01:00.0: card - bus=0x1, slot = 0x0 irq=4
[ 0.971699] shpchp 0000:02:00.0: card - bus=0x2, slot = 0x0 irq=4
[ 0.977621] shpchp 0000:02:04.0: card - bus=0x2, slot = 0x0 irq=4
[ 0.983579] shpchp 0000:02:08.0: card - bus=0x2, slot = 0x0 irq=4
[ 0.989506] shpchp 0000:02:0c.0: card - bus=0x2, slot = 0x0 irq=4
[ 0.995553] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 1.002685] Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
[ 1.010163] printk: console [ttyS0] disabled
[ 1.014445] 10000c00.uartlite: ttyS0 at MMIO 0x10000c00 (irq = 20, base_baud = 2500000) is a Palmchip BK-3103
[ 1.024099] printk: console [ttyS0] enabled
[ 1.032555] printk: bootconsole [early0] disabled
[ 1.062942] spi spi0.0: force spi mode3
[ 1.068184] spi-nor spi0.0: w25q128 (16384 Kbytes)
[ 1.073242] 3 fixed-partitions partitions found on MTD device spi0.0
[ 1.079771] OF: Bad cell count for /palmbus@10000000/spi@b00/flash@0/partitions
[ 1.087322] OF: Bad cell count for /palmbus@10000000/spi@b00/flash@0/partitions
[ 1.095372] Creating 3 MTD partitions on "spi0.0":
[ 1.100289] 0x000000000000-0x000000030000 : "u-boot"
[ 1.109013] 0x000000030000-0x000000040000 : "u-boot-env"
[ 1.116020] 0x000000040000-0x000000050000 : "factory"
[ 1.137983] gsw: ephy base address: 12
[ 1.145037] gsw: setting port4 to ephy mode
[ 1.161238] mtk_soc_eth 10100000.ethernet: generated random MAC address 22:a1:88:18:94:5c
[ 1.172339] mtk_soc_eth 10100000.ethernet: connected port 5 to PHY at mdio-bus:01 [uid=001cc916, driver=Generic PHY]
[ 1.183440] mtk_soc_eth 10100000.ethernet: loaded mt7620 driver
[ 1.190304] mtk_soc_eth 10100000.ethernet eth0: mediatek frame engine at 0xb0100000, irq 5
[ 1.208596] rtc-hym8563 0-0051: registered as rtc0
[ 1.214684] rtc-hym8563 0-0051: setting system clock to 2026-05-30T18:32:49 UTC (1780165969)
[ 1.224588] rt2880_wdt 10000120.watchdog: Initialized
[ 1.245794] NET: Registered PF_INET6 protocol family
[ 1.256047] Segment Routing with IPv6
[ 1.259948] In-situ OAM (IOAM) with IPv6
[ 1.264213] NET: Registered PF_PACKET protocol family
[ 1.269543] 8021q: 802.1Q VLAN Support v1.8
[ 1.277781] Waiting for root device /dev/mmcblk0p2...
[ 1.298349] mmc0: new high speed SDHC card at address 1388
[ 1.311782] mmcblk0: mmc0:1388 MK 14.4 GiB
[ 1.318967] mmcblk0: p1 p2 p3
[ 1.334293] VFS: Mounted root (squashfs filesystem) readonly on device 179:2.
[ 1.348509] Freeing unused kernel image (initmem) memory: 1196K
[ 1.354565] This architecture does not have kernel memory protection.
[ 1.361173] Run /sbin/init as init process
[ 1.365351] with arguments:
[ 1.365357] /sbin/init
[ 1.365366] with environment:
[ 1.365372] HOME=/
[ 1.365380] TERM=linux
[ 1.843837] init: Console is alive
[ 1.848077] init: - watchdog -
[ 2.805574] kmodloader: loading kernel modules from /etc/modules-boot.d/*
[ 2.885376] usbcore: registered new interface driver usbfs
[ 2.891174] usbcore: registered new interface driver hub
[ 2.896816] usbcore: registered new device driver usb
[ 2.907736] usbcore: registered new interface driver usb_ch343
[ 2.913753] ch343: USB serial driver for ch342/ch343/ch344/ch347/ch9101/ch9102/ch9103/ch9104, etc.
[ 2.922945] ch343: V1.5 On 2022.12
[ 2.943545] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 2.955102] fsl-ehci: Freescale EHCI Host controller driver
[ 2.963274] ehci-platform: EHCI generic platform driver
[ 2.979429] phy phy-usbphy.0: remote usb device wakeup disabled
[ 2.985502] phy phy-usbphy.0: UTMI 16bit 30MHz
[ 2.990045] ehci-platform 101c0000.ehci: EHCI Host Controller
[ 2.996004] ehci-platform 101c0000.ehci: new USB bus registered, assigned bus number 1
[ 3.004279] ehci-platform 101c0000.ehci: irq 26, io mem 0x101c0000
[ 3.020263] ehci-platform 101c0000.ehci: USB 2.0 started, EHCI 1.00
[ 3.028042] hub 1-0:1.0: USB hub found
[ 3.032990] hub 1-0:1.0: 1 port detected
[ 3.046256] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 3.055625] ohci-platform: OHCI generic platform driver
[ 3.061581] ohci-platform 101c1000.ohci: Generic Platform OHCI controller
[ 3.068649] ohci-platform 101c1000.ohci: new USB bus registered, assigned bus number 2
[ 3.076976] ohci-platform 101c1000.ohci: irq 26, io mem 0x101c1000
[ 3.111805] hub 2-0:1.0: USB hub found
[ 3.116830] hub 2-0:1.0: 1 port detected
[ 3.130319] kmodloader: done loading kernel modules from /etc/modules-boot.d/*
[ 3.142575] init: - preinit -
[ 3.463890] usb 1-1: new high-speed USB device number 2 using ehci-platform
[ 3.745059] usb_ch343 1-1:1.0: ttyCH343USB0: usb to uart device
[ 3.803141] usb_ch343 1-1:1.2: ttyCH343USB1: usb to uart device
[ 3.814925] usb_ch343 1-1:1.4: ttyCH343USB2: usb to uart device
[ 3.843120] usb_ch343 1-1:1.6: ttyCH343USB3: usb to uart device
[ 3.856200] random: procd: uninitialized urandom read (4 bytes read)
[ 4.270931] random: jshn: uninitialized urandom read (4 bytes read)
[ 4.438512] random: jshn: uninitialized urandom read (4 bytes read)
[ 4.852705] random: jshn: uninitialized urandom read (4 bytes read)
[ 4.928975] random: jshn: uninitialized urandom read (4 bytes read)
[ 5.033839] random: jshn: uninitialized urandom read (4 bytes read)
[ 5.372886] 8021q: adding VLAN 0 to HW filter on device eth0
[ 6.343456] mount_root: loading kmods from internal overlay
[ 6.398447] kmodloader: loading kernel modules from //etc/modules-boot.d/*
[ 6.412394] kmodloader: done loading kernel modules from //etc/modules-boot.d/*
[ 6.765956] block: attempting to load /etc/config/fstab
[ 7.060647] EXT4-fs (mmcblk0p3): recovery complete
[ 7.066281] EXT4-fs (mmcblk0p3): mounted filesystem with ordered data mode. Opts: . Quota mode: disabled.
[ 7.088323] mount_root: switched to extroot
[ 7.100614] urandom-seed: Seeding with /etc/urandom.seed
[ 7.218109] procd: - early -
[ 7.221683] procd: - watchdog -
[ 7.936081] procd: - watchdog -
[ 7.942255] procd: - ubus -
[ 8.143771] random: ubusd: uninitialized urandom read (4 bytes read)
[ 8.159628] random: ubusd: uninitialized urandom read (4 bytes read)
[ 8.180837] random: ubusd: uninitialized urandom read (4 bytes read)
[ 8.203167] procd: - init -
[ 10.018267] random: ubusd: uninitialized urandom read (4 bytes read)
[ 10.602225] kmodloader: loading kernel modules from /etc/modules.d/*
[ 10.910520] i2c_dev: i2c /dev entries driver
[ 10.926261] pca953x 0-0024: supply vcc not found, using dummy regulator
[ 10.933555] pca953x 0-0024: using no AI
[ 10.971569] miop: module license 'MIXTILE' taints kernel.
[ 10.977180] Disabling lock debugging due to kernel taint
[ 11.110906] PPP generic driver version 2.4.2
[ 11.122370] NET: Registered PF_PPPOX protocol family
[ 11.147983] kmodloader: done loading kernel modules from /etc/modules.d/*
[ 14.643144] random: crng init done
[ 14.646685] random: 52 urandom warning(s) missed due to ratelimiting
[ 21.737447] 8021q: adding VLAN 0 to HW filter on device eth0
[ 21.780693] device eth0 entered promiscuous mode
[ 21.804976] br-lan: port 1(eth0.1) entered blocking state
[ 21.810663] br-lan: port 1(eth0.1) entered disabled state
[ 21.816580] device eth0.1 entered promiscuous mode
[ 27.352416] pci_bus 0000:03: busn_res: [bus 03] is released
[ 27.358651] pci_bus 0000:04: busn_res: [bus 04] is released
[ 27.364702] pci_bus 0000:05: busn_res: [bus 05] is released
[ 27.370836] pci_bus 0000:06: busn_res: [bus 06] is released
[ 27.376904] pci_bus 0000:02: busn_res: [bus 02-06] is released
[ 27.383300] pci_bus 0000:01: busn_res: [bus 01-06] is released
[ 27.485033] pci 0000:00:00.0: [1814:0801] type 01 class 0x060400
[ 27.491278] pci 0000:00:00.0: reg 0x10: [mem 0x00000000-0x7fffffff]
[ 27.497718] pci 0000:00:00.0: reg 0x14: [mem 0x20000000-0x2000ffff]
[ 27.504244] pci 0000:00:00.0: supports D1
[ 27.508388] pci 0000:00:00.0: PME# supported from D0 D1 D3hot
[ 27.516940] pci 0000:01:00.0: [1b21:2824] type 01 class 0x060400
[ 27.523415] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[ 27.529710] pci 0000:01:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[ 27.547583] pci 0000:02:00.0: [1b21:2824] type 01 class 0x060400
[ 27.554031] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[ 27.561021] pci 0000:02:04.0: [1b21:2824] type 01 class 0x060400
[ 27.567449] pci 0000:02:04.0: PME# supported from D0 D3hot D3cold
[ 27.574449] pci 0000:02:08.0: [1b21:2824] type 01 class 0x060400
[ 27.580925] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold
[ 27.587897] pci 0000:02:0c.0: [1b21:2824] type 01 class 0x060400
[ 27.594348] pci 0000:02:0c.0: PME# supported from D0 D3hot D3cold
[ 27.602628] pci 0000:03:00.0: [4586:b6f2] type 00 class 0x028000
[ 27.608898] pci 0000:03:00.0: reg 0x10: [mem 0x00000000-0x01ffffff 64bit pref]
[ 27.616377] pci 0000:03:00.0: reg 0x20: [mem 0x00000000-0x000fffff 64bit pref]
[ 27.623799] pci 0000:03:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[ 27.630873] pci 0000:03:00.0: supports D1 D2
[ 27.635252] pci 0000:03:00.0: PME# supported from D0 D1 D3hot
[ 27.641235] pci 0000:03:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 27.658883] pci_bus 0000:03: busn_res: [bus 03-06] end is updated to 03
[ 27.666062] pci 0000:04:00.0: [4586:b6f2] type 00 class 0x028000
[ 27.672342] pci 0000:04:00.0: reg 0x10: [mem 0x00000000-0x01ffffff 64bit pref]
[ 27.679815] pci 0000:04:00.0: reg 0x20: [mem 0x00000000-0x000fffff 64bit pref]
[ 27.687230] pci 0000:04:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[ 27.694317] pci 0000:04:00.0: supports D1 D2
[ 27.698707] pci 0000:04:00.0: PME# supported from D0 D1 D3hot
[ 27.704683] pci 0000:04:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 27.722253] pci_bus 0000:04: busn_res: [bus 04-06] end is updated to 04
[ 27.729489] pci 0000:05:00.0: [4586:b6f2] type 00 class 0x028000
[ 27.735736] pci 0000:05:00.0: reg 0x10: [mem 0x00000000-0x01ffffff 64bit pref]
[ 27.743230] pci 0000:05:00.0: reg 0x20: [mem 0x00000000-0x000fffff 64bit pref]
[ 27.750672] pci 0000:05:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[ 27.757747] pci 0000:05:00.0: supports D1 D2
[ 27.762130] pci 0000:05:00.0: PME# supported from D0 D1 D3hot
[ 27.768111] pci 0000:05:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 27.785678] pci_bus 0000:05: busn_res: [bus 05-06] end is updated to 05
[ 27.792890] pci 0000:06:00.0: [4586:b6f2] type 00 class 0x028000
[ 27.799184] pci 0000:06:00.0: reg 0x10: [mem 0x00000000-0x01ffffff 64bit pref]
[ 27.806645] pci 0000:06:00.0: reg 0x20: [mem 0x00000000-0x000fffff 64bit pref]
[ 27.814072] pci 0000:06:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[ 27.821153] pci 0000:06:00.0: supports D1 D2
[ 27.825529] pci 0000:06:00.0: PME# supported from D0 D1 D3hot
[ 27.831507] pci 0000:06:00.0: 2.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x1 link at 0000:00:00.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 27.849143] pci_bus 0000:06: busn_res: [bus 06] end is updated to 06
[ 27.855681] pci_bus 0000:02: busn_res: [bus 02-06] end is updated to 06
[ 27.862483] pci_bus 0000:01: busn_res: [bus 01-06] end is updated to 06
[ 27.869343] pci 0000:00:00.0: BAR 0: no space for [mem size 0x80000000]
[ 27.876122] pci 0000:00:00.0: BAR 0: failed to assign [mem size 0x80000000]
[ 27.883265] pci 0000:00:00.0: BAR 9: assigned [mem 0x20000000-0x2bffffff pref]
[ 27.890669] pci 0000:00:00.0: BAR 8: assigned [mem 0x2c000000-0x2c3fffff]
[ 27.897625] pci 0000:00:00.0: BAR 1: assigned [mem 0x2c400000-0x2c40ffff]
[ 27.904600] pci 0000:01:00.0: BAR 9: assigned [mem 0x20000000-0x2bffffff 64bit pref]
[ 27.912559] pci 0000:01:00.0: BAR 8: assigned [mem 0x2c000000-0x2c3fffff]
[ 27.919542] pci 0000:02:00.0: BAR 9: assigned [mem 0x20000000-0x22ffffff 64bit pref]
[ 27.927475] pci 0000:02:04.0: BAR 9: assigned [mem 0x23000000-0x25ffffff 64bit pref]
[ 27.935421] pci 0000:02:08.0: BAR 9: assigned [mem 0x26000000-0x28ffffff 64bit pref]
[ 27.943367] pci 0000:02:0c.0: BAR 9: assigned [mem 0x29000000-0x2bffffff 64bit pref]
[ 27.951307] pci 0000:02:00.0: BAR 8: assigned [mem 0x2c000000-0x2c0fffff]
[ 27.958273] pci 0000:02:04.0: BAR 8: assigned [mem 0x2c100000-0x2c1fffff]
[ 27.965227] pci 0000:02:08.0: BAR 8: assigned [mem 0x2c200000-0x2c2fffff]
[ 27.972184] pci 0000:02:0c.0: BAR 8: assigned [mem 0x2c300000-0x2c3fffff]
[ 27.979161] pci 0000:03:00.0: BAR 0: assigned [mem 0x20000000-0x21ffffff 64bit pref]
[ 27.987109] pci 0000:03:00.0: BAR 4: assigned [mem 0x22000000-0x220fffff 64bit pref]
[ 27.995075] pci 0000:03:00.0: BAR 6: assigned [mem 0x2c000000-0x2c00ffff pref]
[ 28.002491] pci 0000:02:00.0: PCI bridge to [bus 03]
[ 28.007585] pci 0000:02:00.0: bridge window [mem 0x2c000000-0x2c0fffff]
[ 28.014551] pci 0000:02:00.0: bridge window [mem 0x20000000-0x22ffffff 64bit pref]
[ 28.022512] pci 0000:04:00.0: BAR 0: assigned [mem 0x24000000-0x25ffffff 64bit pref]
[ 28.030489] pci 0000:04:00.0: BAR 4: assigned [mem 0x23000000-0x230fffff 64bit pref]
[ 28.038457] pci 0000:04:00.0: BAR 6: assigned [mem 0x2c100000-0x2c10ffff pref]
[ 28.045851] pci 0000:02:04.0: PCI bridge to [bus 04]
[ 28.050982] pci 0000:02:04.0: bridge window [mem 0x2c100000-0x2c1fffff]
[ 28.057941] pci 0000:02:04.0: bridge window [mem 0x23000000-0x25ffffff 64bit pref]
[ 28.065899] pci 0000:05:00.0: BAR 0: assigned [mem 0x26000000-0x27ffffff 64bit pref]
[ 28.073869] pci 0000:05:00.0: BAR 4: assigned [mem 0x28000000-0x280fffff 64bit pref]
[ 28.081827] pci 0000:05:00.0: BAR 6: assigned [mem 0x2c200000-0x2c20ffff pref]
[ 28.089239] pci 0000:02:08.0: PCI bridge to [bus 05]
[ 28.094328] pci 0000:02:08.0: bridge window [mem 0x2c200000-0x2c2fffff]
[ 28.101291] pci 0000:02:08.0: bridge window [mem 0x26000000-0x28ffffff 64bit pref]
[ 28.109252] pci 0000:06:00.0: BAR 0: assigned [mem 0x2a000000-0x2bffffff 64bit pref]
[ 28.117201] pci 0000:06:00.0: BAR 4: assigned [mem 0x29000000-0x290fffff 64bit pref]
[ 28.125167] pci 0000:06:00.0: BAR 6: assigned [mem 0x2c300000-0x2c30ffff pref]
[ 28.132585] pci 0000:02:0c.0: PCI bridge to [bus 06]
[ 28.137685] pci 0000:02:0c.0: bridge window [mem 0x2c300000-0x2c3fffff]
[ 28.144658] pci 0000:02:0c.0: bridge window [mem 0x29000000-0x2bffffff 64bit pref]
[ 28.152606] pci 0000:01:00.0: PCI bridge to [bus 02-06]
[ 28.157967] pci 0000:01:00.0: bridge window [mem 0x2c000000-0x2c3fffff]
[ 28.164926] pci 0000:01:00.0: bridge window [mem 0x20000000-0x2bffffff 64bit pref]
[ 28.172871] pci 0000:00:00.0: PCI bridge to [bus 01-06]
[ 28.178235] pci 0000:00:00.0: bridge window [mem 0x2c000000-0x2c3fffff]
[ 28.185189] pci 0000:00:00.0: bridge window [mem 0x20000000-0x2bffffff pref]
[ 28.192726] shpchp 0000:00:00.0: card - bus=0x0, slot = 0x0 irq=0
[ 28.199120] shpchp 0000:01:00.0: card - bus=0x1, slot = 0x0 irq=4
[ 28.205489] shpchp 0000:02:00.0: card - bus=0x2, slot = 0x0 irq=4
[ 28.211886] shpchp 0000:02:04.0: card - bus=0x2, slot = 0x0 irq=4
[ 28.218286] shpchp 0000:02:08.0: card - bus=0x2, slot = 0x0 irq=4
[ 28.224646] shpchp 0000:02:0c.0: card - bus=0x2, slot = 0x0 irq=4
[ 28.231048] miop 0000:03:00.0: card - bus=0x3, slot = 0x0 irq=4
[ 28.237157] miop 0000:03:00.0: probing MIOP node on bus:03
[ 29.119069] miop 0000:03:00.0: PCIe bus number 3 mapped to MIOP node id: 2
[ 29.127321] miop 0000:03:00.0: pci_alloc_irq_vectors() only alloc 1 vectors
[ 29.134566] miop 0000:03:00.0: unknown ep desc layout: 0x00000103
[ 29.140822] miop 0000:03:00.0: miop_node_init() failed: -22
[ 29.229453] miop: probe of 0000:03:00.0 failed with error -22
[ 29.235618] miop 0000:04:00.0: card - bus=0x4, slot = 0x0 irq=4
[ 29.241782] miop 0000:04:00.0: probing MIOP node on bus:04
[ 29.325351] miop 0000:04:00.0: PCIe bus number 4 mapped to MIOP node id: 3
[ 29.333653] miop 0000:04:00.0: pci_alloc_irq_vectors() only alloc 1 vectors
[ 29.340862] miop 0000:04:00.0: unknown ep desc layout: 0x00000103
[ 29.347102] miop 0000:04:00.0: miop_node_init() failed: -22
[ 29.490660] miop: probe of 0000:04:00.0 failed with error -22
[ 29.496792] miop 0000:05:00.0: card - bus=0x5, slot = 0x0 irq=4
[ 29.502959] miop 0000:05:00.0: probing MIOP node on bus:05
[ 29.559490] miop 0000:05:00.0: PCIe bus number 5 mapped to MIOP node id: 1
[ 29.567758] miop 0000:05:00.0: pci_alloc_irq_vectors() only alloc 1 vectors
[ 29.574974] miop 0000:05:00.0: unknown ep desc layout: 0x00000103
[ 29.581220] miop 0000:05:00.0: miop_node_init() failed: -22
[ 29.695457] miop: probe of 0000:05:00.0 failed with error -22
[ 29.701671] miop 0000:06:00.0: card - bus=0x6, slot = 0x0 irq=4
[ 29.707792] miop 0000:06:00.0: probing MIOP node on bus:06
[ 29.769666] miop 0000:06:00.0: PCIe bus number 6 mapped to MIOP node id: 0
[ 29.777904] miop 0000:06:00.0: pci_alloc_irq_vectors() only alloc 1 vectors
[ 29.785140] miop 0000:06:00.0: unknown ep desc layout: 0x00000103
[ 29.791406] miop 0000:06:00.0: miop_node_init() failed: -22
[ 29.912819] miop: probe of 0000:06:00.0 failed with error -22
[ 32.935191] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 32.965169] br-lan: port 1(eth0.1) entered blocking state
[ 32.970803] br-lan: port 1(eth0.1) entered forwarding state
[ 32.976929] IPv6: ADDRCONF(NETDEV_CHANGE): eth0.2: link becomes ready
[ 33.028235] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[ 33.488430] mtk_soc_eth 10100000.ethernet eth0: port 5 link up (100Mbps/Full duplex)
This looks like a mismatch between the control board and the Blade3 PCIe driver. Have you flashed the latest image and deleted the /overlay/upper/lib/modules/5.15.150/miop.ko file on the control board?
After I reflashed and verified the file was not present, it was working. If I had to guess, I probably misunderstood instructions initially and placed the file in that directory when following your other instructions. We no longer need to replace the kernel object in the filesystem, right?
Yes, the “other instructions” you mentioned are from the test version. You only need to focus on the top pinned update post.
1 Like