xref: /openbmc/qemu/docs/pci_expander_bridge.txt (revision 2e1cacfb)
1PCI EXPANDER BRIDGE (PXB)
2=========================
3
4Description
5===========
6PXB is a "light-weight" host bridge in the same PCI domain
7as the main host bridge whose purpose is to enable
8the main host bridge to support multiple PCI root buses.
9It is implemented only for i440fx and can be placed only
10on bus 0 (pci.0).
11
12As opposed to PCI-2-PCI bridge's secondary bus, PXB's bus
13is a primary bus and can be associated with a NUMA node
14(different from the main host bridge) allowing the guest OS
15to recognize the proximity of a pass-through device to
16other resources as RAM and CPUs.
17
18Usage
19=====
20A detailed command line would be:
21
22[qemu-bin + storage options]
23-m 2G
24-object memory-backend-ram,size=1024M,policy=bind,host-nodes=0,id=ram-node0 -numa node,nodeid=0,cpus=0,memdev=ram-node0
25-object memory-backend-ram,size=1024M,policy=bind,host-nodes=1,id=ram-node1 -numa node,nodeid=1,cpus=1,memdev=ram-node1
26-device pxb,id=bridge1,bus=pci.0,numa_node=1,bus_nr=4 -netdev user,id=nd -device e1000,bus=bridge1,addr=0x4,netdev=nd
27-device pxb,id=bridge2,bus=pci.0,numa_node=0,bus_nr=8 -device e1000,bus=bridge2,addr=0x3
28-device pxb,id=bridge3,bus=pci.0,bus_nr=40 -drive if=none,id=drive0,file=[img] -device virtio-blk-pci,drive=drive0,bus=bridge3,addr=1
29
30Here you have:
31 - 2 NUMA nodes for the guest, 0 and 1. (both mapped to the same NUMA node in host, but you can and should put it in different host NUMA nodes)
32 - a pxb host bridge attached to NUMA 1 with an e1000 behind it
33 - a pxb host bridge attached to NUMA 0 with an e1000 behind it
34 - a pxb host bridge not attached to any NUMA with a hard drive behind it.
35
36Limitations
37===========
38Please observe that we specified the bus "pci.0" for the second and third pxb.
39This is because when no bus is given, another pxb can be selected by QEMU as default bus,
40however, PXBs can be placed only under the root bus.
41
42Implementation
43==============
44The PXB is composed by:
45- HostBridge (TYPE_PXB_HOST)
46  The host bridge allows to register and query the PXB's PCI root bus in QEMU.
47- PXBDev(TYPE_PXB_DEVICE)
48  It is a regular PCI Device that resides on the piix host-bridge bus and its bus uses the same PCI domain.
49  However, the bus behind is exposed through ACPI as a primary PCI bus and starts a new PCI hierarchy.
50  The interrupts from devices behind the PXB are routed through this device the same as if it were a
51  PCI-2-PCI bridge. The _PRT follows the i440fx model.
52- PCIBridgeDev(TYPE_PCI_BRIDGE_DEV)
53  Created automatically as part of init sequence.
54  When adding a device to PXB it is attached to the bridge for two reasons:
55  - Using the bridge will enable hotplug support
56  - All the devices behind the bridge will use bridge's IO/MEM windows compacting
57    the PCI address space.
58
59