Intel CPU服务器2TB内存下，hyperenclave启动失败

[bronzeMe]

Your Question

物理内存2TB时，启动hyperencalve失败，失败原因和这个issue中的前期的报错类似“panicked at 'index out of bounds: the len is 32 but the index is 32', /home/test/.cargo/registry/src/github.com-1ecc6299db9ec823/buddy_system_allocator-0.5.0/src/lib.rs:90:13”
，这个issue中提到的workaround patch 看起来不适用于Intel CPU架构,

Q1: 是否需要如这个issue12中的这里修改一下bitmap_allocator呢
Q2：针对Intel CPU，2TB的内存场景下，应该是不需要如下的patch对吧？

#workaround patch
$git diff src/cell.rs
diff --git a/src/cell.rs b/src/cell.rs
index 928e1e1..f618087 100644
--- a/src/cell.rs
+++ b/src/cell.rs
@@ -140,29 +140,12 @@ impl Cell {
         for region in sys_config.mem_regions() {
             if region.flags.contains(MemFlags::DMA) {
                 let hv_virt_start = phys_to_virt(region.virt_start as GuestPhysAddr);
-                if hv_virt_start < region.virt_start as GuestPhysAddr {
-                    return hv_result_err!(
-                        EINVAL,
-                        format!(
-                            "Guest physical address {:#x} is too large",
-                            region.virt_start
-                        )
-                    );
-                }
                 hvm.insert(MemoryRegion::new_with_offset_mapper(
                     hv_virt_start,
                     region.phys_start as HostPhysAddr,
                     region.size as usize,
                     MemFlags::READ | MemFlags::WRITE,
                 ))?;
-                // Support hardware encrypt when swap out EPC page to guest RAM
-                #[cfg(feature = "sme")]
-                hvm.insert(MemoryRegion::new_with_offset_mapper(
-                    region.virt_start as HostVirtAddr,
-                    region.phys_start as HostPhysAddr,
-                    region.size as usize,
-                    MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
-                ))?;
                 normal_world_mem_region.insert(
                     (region.phys_start as usize)..(region.phys_start + region.size) as usize,
                 )?;

系统/CPU/内核信息

 ##lscpu
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   46 bits physical, 57 bits virtual
CPU(s):                          224
On-line CPU(s) list:             0-223
Thread(s) per core:              2
Core(s) per socket:              56
Socket(s):                       2
NUMA node(s):                    2
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           207
Model name:                      INTEL(R) XEON(R) PLATINUM 8538C
Stepping:                        2
Frequency boost:                 enabled
CPU MHz:                         800.000
CPU max MHz:                     4000.0000
CPU min MHz:                     800.0000
BogoMIPS:                        5200.00
Virtualization:                  VT-x
L1d cache:                       5.3 MiB
L1i cache:                       3.5 MiB
L2 cache:                        224 MiB
L3 cache:                        560 MiB
NUMA node0 CPU(s):               0-55,112-167
NUMA node1 CPU(s):               56-111,168-223
Vulnerability Itlb multihit:     Not affected
Vulnerability L1tf:              Not affected
Vulnerability Mds:               Not affected
Vulnerability Meltdown:          Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:        Mitigation; Enhanced IBRS, IBPB conditional, RSB filling
Vulnerability Tsx async abort:   Not affected

###内存
test@test:~$ lsmem
RANGE                                  SIZE  STATE REMOVABLE     BLOCK
0x0000000000000000-0x000000007fffffff    2G online        no         0
0x0000004100000000-0x0000005dffffffff  116G online       yes   130-187
0x0000005e00000000-0x0000005e7fffffff    2G online        no       188
0x0000005e80000000-0x000000fa7fffffff  624G online       yes   189-500
0x000000fa80000000-0x000000fb7fffffff    4G online        no   501-502
0x000000fb80000000-0x000000fbffffffff    2G online       yes       503
0x000000fc00000000-0x000001007fffffff   18G online        no   504-512
0x0000010080000000-0x000001fbffffffff 1006G online       yes  513-1015
0x000001fc00000000-0x000002007fffffff   18G online        no 1016-1024

Memory block size:         2G
Total online memory:     1.8T
Total offline memory:      0B
test@test:~$ cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-5.4.0-custom root=UUID=d9c98664-2f04-4901-a426-1cf58139d6b3 ro memmap=256G$0x100000000 intel_iommu=off intermap=off no5lvl ima_policy=tcb ima_hash=sha256 ima_appraise=fix evm=fi
### OS-kernel
test@test:~$ cat /etc/os-release
NAME="Ubuntu"
VERSION="20.04.6 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.6 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal
test@test:~$ uname -a
Linux test 5.4.0-custom #1 SMP Thu Aug 22 05:22:55 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Relevant Documentation or Forum Link

SOL 日志

Secondary CPU 183 entered.
Secondary CPU 84 entered.
Secondary CPU 121 entered.
Secondary CPU 71 entered.
Secondary CPU 60 entered.
Secondary CPU 142 entered.
Secondary CPU 39 entered.
Secondary CPU 21 entered.
Secondary CPU 64 entered.
Primary CPU 3 entered.
Secondary CPU 147 entered.
Secondary CPU 151 entered.
Secondary CPU 133 entered.
Secondary CPU 35 entered.
Secondary CPU 126 entered.
Secondary CPU 135 entered.
Secondary CPU 16 entered.
Secondary CPU 27 entered.

Initializing hypervisor...
build_mode = release
log_level = warn
arch = x86_64
vendor = intel
stats = off
sme = off
epc = epc48

Secondary CPU 128 entered.
Secondary CPU 119 entered.
Secondary CPU 14 entered.
Secondary CPU 131 entered.
Secondary CPU 52 entered.
Secondary CPU 157 entered.
Secondary CPU 30 entered.
Secondary CPU 26 entered.
Secondary CPU 139 entered.
Secondary CPU 9 entered.
Secondary CPU 123 entered.
reclaim crypto algorithm: EncSWHmacSW
Secondary CPU 188 entered.
Secondary CPU 13 entered.
Secondary CPU 150 entered.
Secondary CPU 217 entered.
Secondary CPU 116 entered.
Secondary CPU 23 entered.
Secondary CPU 114 entered.
Secondary CPU 164 entered.
[ERROR][6]
panicked at 'index out of bounds: the len is 32 but the index is 32', /home/test/.cargo/registry/src/github.com-1ecc6299db9ec823/buddy_system_allocator-0.5.0/src/lib.rs:90:13
Current Cpu: PerCpu {
   cpu_id:

[bronzeMe]

Follow issue12进行了如下尝试

尝试1：

• 代码修改

+++ b/Cargo.toml
@@ -27,7 +27,7 @@ spin = "0.9.8"
 bitflags = "1.2"
 bit_field = "0.10"
 numeric-enum-macro = "0.2"
-buddy_system_allocator = "0.5"
+buddy_system_allocator = "0.8"
 libvmm = { path = "./crates/libvmm", default-features = false }
 uart_16550 = { path = "./crates/uart_16550" }
 lazy_static = { version = "1.4", features = ["spin_no_std"] }
diff --git a/src/memory/heap.rs b/src/memory/heap.rs
index 7234a39..900e01d 100644
--- a/src/memory/heap.rs
+++ b/src/memory/heap.rs
@@ -23,7 +23,7 @@ use crate::memory::addr::{align_up, is_aligned, virt_to_phys};
 use crate::memory::HostVirtAddr;
 
 #[cfg_attr(not(test), global_allocator)]
-static HEAP_ALLOCATOR: LockedHeap = LockedHeap::new();
+static HEAP_ALLOCATOR: LockedHeap<64> = LockedHeap::<64>::new();

• 测试结果：

Initializing hypervisor...
build_mode = release
log_level = warn
arch = x86_64
vendor = intel
stats = off
sme = off
epc = epc48

Secondary CPU 218 entered.
Secondary CPU 64 entered.
Secondary CPU 84 entered.
reclaim crypto algorithm: EncSWHmacSW
Secondary CPU 203 entered.
Secondary CPU 83 entered.
Secondary CPU 85 entered.
[ERROR][133]
panicked at 'assertion failed: end <= Self::CAP', /home/test/.cargo/git/checkouts/bitmap-allocator-98b9ef9bd0253b32/03bd990/src/lib.rs:120:9
Current Cpu: PerCpu {
    cpu_id:

尝试2

• 代码修改：

index a0552ba..a4841a8 100644
--- a/src/memory/frame.rs
+++ b/src/memory/frame.rs
@@ -28,7 +28,7 @@ use crate::memory::cmr::{CMRM_SIZE_ALIGNED, CMRM_START_HVA};
 use crate::memory::HV_HEAP_SIZE;

 // Support max 1M * 4096 = 4GB memory.
-type FrameAlloc = bitmap_allocator::BitAlloc1M;
+type FrameAlloc = bitmap_allocator::BitAlloc16M;

 struct FrameAllocator {
     base: PhysAddr,
diff --git a/src/memory/heap.rs b/src/memory/heap.rs
index 7234a39..9b2df71 100644

• 测试结果

#### dmesg logs
[  418.643784] HE: mem_test: 79. Memory[0x3500000000 - 0x3700000000] test pass
[  418.643790] HE: mem_test: 49. Memory[0x3700000000 - 0x3900000000] test begin
[  423.533880] HE: mem_test: 79. Memory[0x3700000000 - 0x3900000000] test pass
[  423.533890] HE: mem_test: 49. Memory[0x3900000000 - 0x3b00000000] test begin
[  427.948972] HE: mem_test: 79. Memory[0x3900000000 - 0x3b00000000] test pass
[  427.948982] HE: mem_test: 49. Memory[0x3b00000000 - 0x3d00000000] test begin
[  429.739577] INFO: NMI handler (ghes_notify_nmi) took too long to run: 90.597 msecs
[  432.899498] HE: mem_test: 79. Memory[0x3b00000000 - 0x3d00000000] test pass
[  432.899510] HE: mem_test: 49. Memory[0x3d00000000 - 0x3f00000000] test begin
[  437.957693] HE: mem_test: 79. Memory[0x3d00000000 - 0x3f00000000] test pass
[  437.957707] HE: mem_test: 49. Memory[0x3f00000000 - 0x4100000000] test begin
[  442.977229] HE: mem_test: 79. Memory[0x3f00000000 - 0x4100000000] test pass
[  443.031155] HE: get_hv_heap_size: 377. Hypervisor heap size: 0x23f800000
[  443.031156] HE: get_hv_cmrm_size: 389. Hypervisor cmrm size: 0x300c00000
[  443.031157] HE: get_hv_frame_size: 402. Hypervisor frame size: 0xffc00000
[  443.031158] HE: get_hypervisor_size: 415. Hv_core_and_percpu_size: 0x78f1000, Hypervisor size: 0x680000000
[  443.031159] HE: he_cmd_enable: 290. hypervisor size: 0x680000000

#### SOL logs
econdary CPU 70 entered.
Secondary CPU 110 entered.
reclaim crypto algorithm: EncSWHmacSW
Secondary CPU 174 entered.
Secondary CPU 213 entered.
Secondary CPU 22 entered.
Secondary CPU 182 entered.
Secondary CPU 75 entered.
Secondary CPU 137 entered.
Secondary CPU 6 entered.
Secondary CPU 143 entered.
Secondary CPU 120 entered.
Secondary CPU 140 entered.
tpm mmio is mapped va=0xfed40000
Secondary CPU 109 entered.
Secondary CPU 108 entered.
Secondary CPU 150 entered.
Secondary CPU 51 entered.
Secondary CPU 170 entered.
Secondary CPU 58 entered.
Secondary CPU 79 entered.
Secondary CPU 184 entered.
Secondary CPU 72 entered.
Secondary CPU 175 entered.
[ERROR][183]
panicked at 'called `Result::unwrap()` on an `Err` value: [src/memory/paging.rs:46:18] Bad address: AlreadyMapped((3221225472, 26975780864, READ | WRITE | EXECUTE | USER, Size1G))', src/cell.rs:218:55
Current Cpu: PerCpu {
    cpu_id:

[Bonjourz]

Hi @bronzeMe ,

For the last try, the log:

panicked at 'called `Result::unwrap()` on an `Err` value: [src/memory/paging.rs:46:18] Bad address: AlreadyMapped((3221225472, 26975780864, READ | WRITE | EXECUTE | USER, Size1G))', src/cell.rs:218:55

indicates there exists error in src/cell.rs. Could you show us which line of code in Cell::new_root() raise that error?

[bronzeMe]

cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-5.4.0-custom root=UUID=d9c98664-2f04-4901-a426-1cf58139d6b3 ro memmap=128G$0x100000000 intel_iommu=off intermap=off no5lvl ima_policy=tcb ima_hash=sha256 ima_appraise=fix evm=fix

• 我们尝试过把memmap=128G$0x100000000 调整为memmap=128G$0x400000000也没解决问题
  我们尝试对cell.rs注释掉一些代码，添加一下日志打印：

diff --git a/src/cell.rs b/src/cell.rs
index 928e1e1..0fa13f3 100644
--- a/src/cell.rs
+++ b/src/cell.rs
@@ -45,7 +45,10 @@ impl Cell {
         let mut hvm = MemorySet::new();
         let mut dma_regions = MemorySet::new();
         let mut normal_world_mem_region = IntervalTree::new();
-
+        info!("Mapping hypervisor memory: start={:#x}, size={:#x}",
+            hv_phys_start,
+            hv_phys_size
+        );
         // Init guest physical memory set, create hypervisor page table.
         //
         // map hypervisor memory to empty in gpm
@@ -56,6 +59,10 @@ impl Cell {
             hv_phys_size,
             MemFlags::READ | MemFlags::ENCRYPTED,
         ))?;
+        info!("Finished hypervisor memory map: start={:#x}, size={:#x}",
+            hv_phys_start,
+            hv_phys_size
+        );
         // preventing guest vm read out the encrypted view of EPC
         // from high addr with c-bit = 1
         // expected behavior: return plaintext view of the empty page
@@ -80,12 +87,18 @@ impl Cell {
                 epc_size,
                 MemFlags::READ | MemFlags::ENCRYPTED,
             ))?;
-            #[cfg(feature = "sme")]
-            gpm.insert(MemoryRegion::new_with_empty_mapper(
-                crate::memory::addr::phys_encrypted(epc_start_hpa),
-                epc_size,
-                MemFlags::READ | MemFlags::ENCRYPTED,
-            ))?;
+            info!(
+                "Finished map epc to empty page in gpm, epc_range: [{:#x}, {:#x}], {:#x}",
+                epc_start_hpa,
+                epc_start_hpa + epc_size - 1,
+                epc_size
+            );
+            // #[cfg(feature = "sme")]
+            // gpm.insert(MemoryRegion::new_with_empty_mapper(
+            //     crate::memory::addr::phys_encrypted(epc_start_hpa),
+            //     epc_size,
+            //     MemFlags::READ | MemFlags::ENCRYPTED,
+            // ))?;
         }

         // all physical memory regions
@@ -140,15 +153,16 @@ impl Cell {
         for region in sys_config.mem_regions() {
             if region.flags.contains(MemFlags::DMA) {
                 let hv_virt_start = phys_to_virt(region.virt_start as GuestPhysAddr);
-                if hv_virt_start < region.virt_start as GuestPhysAddr {
-                    return hv_result_err!(
-                        EINVAL,
-                        format!(
-                            "Guest physical address {:#x} is too large",
-                            region.virt_start
-                        )
-                    );
-                }
+                // if hv_virt_start < region.virt_start as GuestPhysAddr {
+                //     return hv_result_err!(
+                //         EINVAL,
+                //         format!(
+                //             "Guest physical address {:#x} is too large",
+                //             region.virt_start
+                //         )
+                //     );
+                // }
+                println!("hvm.insert va={:#x}",hv_virt_start);
                 hvm.insert(MemoryRegion::new_with_offset_mapper(
                     hv_virt_start,
                     region.phys_start as HostPhysAddr,
@@ -156,13 +170,14 @@ impl Cell {
                     MemFlags::READ | MemFlags::WRITE,
                 ))?;
                 // Support hardware encrypt when swap out EPC page to guest RAM
-                #[cfg(feature = "sme")]
-                hvm.insert(MemoryRegion::new_with_offset_mapper(
-                    region.virt_start as HostVirtAddr,
-                    region.phys_start as HostPhysAddr,
-                    region.size as usize,
-                    MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
-                ))?;
+                // #[cfg(feature = "sme")]
+                // hvm.insert(MemoryRegion::new_with_offset_mapper(
+                //     region.virt_start as HostVirtAddr,
+                //     region.phys_start as HostPhysAddr,
+                //     region.size as usize,
+                //     MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
+                // ))?;
+                println!("normal_world_mem_region.insert phys_start={:#x}",region.phys_start);
                 normal_world_mem_region.insert(
                     (region.phys_start as usize)..(region.phys_start + region.size) as usize,
                 )?;
(END)
+                println!("hvm.insert va={:#x}",hv_virt_start);
                 hvm.insert(MemoryRegion::new_with_offset_mapper(
                     hv_virt_start,
                     region.phys_start as HostPhysAddr,
@@ -156,13 +170,14 @@ impl Cell {
                     MemFlags::READ | MemFlags::WRITE,
                 ))?;
                 // Support hardware encrypt when swap out EPC page to guest RAM
-                #[cfg(feature = "sme")]
-                hvm.insert(MemoryRegion::new_with_offset_mapper(
-                    region.virt_start as HostVirtAddr,
-                    region.phys_start as HostPhysAddr,
-                    region.size as usize,
-                    MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
-                ))?;
+                // #[cfg(feature = "sme")]
+                // hvm.insert(MemoryRegion::new_with_offset_mapper(
+                //     region.virt_start as HostVirtAddr,
+                //     region.phys_start as HostPhysAddr,
+                //     region.size as usize,
+                //     MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
+                // ))?;
+                println!("normal_world_mem_region.insert phys_start={:#x}",region.phys_start);
                 normal_world_mem_region.insert(
                     (region.phys_start as usize)..(region.phys_start + region.size) as usize,
                 )?;

+                println!("hvm.insert va={:#x}",hv_virt_start);
                 hvm.insert(MemoryRegion::new_with_offset_mapper(
                     hv_virt_start,
                     region.phys_start as HostPhysAddr,
@@ -156,13 +170,14 @@ impl Cell {
                     MemFlags::READ | MemFlags::WRITE,
                 ))?;
                 // Support hardware encrypt when swap out EPC page to guest RAM
-                #[cfg(feature = "sme")]
-                hvm.insert(MemoryRegion::new_with_offset_mapper(
-                    region.virt_start as HostVirtAddr,
-                    region.phys_start as HostPhysAddr,
-                    region.size as usize,
-                    MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
-                ))?;
+                // #[cfg(feature = "sme")]
+                // hvm.insert(MemoryRegion::new_with_offset_mapper(
+                //     region.virt_start as HostVirtAddr,
+                //     region.phys_start as HostPhysAddr,
+                //     region.size as usize,
+                //     MemFlags::READ | MemFlags::WRITE | MemFlags::ENCRYPTED,
+                // ))?;
+                println!("normal_world_mem_region.insert phys_start={:#x}",region.phys_start);
                 normal_world_mem_region.insert(
                     (region.phys_start as usize)..(region.phys_start + region.size) as usize,
                 )?;
~

从DEBUG日志来看, 应该是这行代码触发了报错 https://github.com/asterinas/hyperenclave/blob/master/src/cell.rs#L152

SOL日志：

[INFO][17] Primary CPU init early...
Secondary CPU 175 entered.
Secondary CPU 63 entered.
Secondary CPU 75 entered.
Secondary CPU 41 entered.
Secondary CPU 51 entered.

Initializing hypervisor...
build_mode = release
log_level = debug
arch = x86_64
vendor = intel
stats = off
sme = off
epc = epc48

Secondary CPU 42 entered.
Secondary CPU 114 entered.
Secondary CPU 64 entered.
Secondary CPU 137 entered.
Secondary CPU 211 entered.
Secondary CPU 190 entered.
Secondary CPU 187 entered.
Secondary CPU 25 entered.
Secondary CPU 68 entered.
Secondary CPU 155 entered.
Secondary CPU 148 entered.
Secondary CPU 221 entered.
Secondary CPU 109 entered.
Secondary CPU 10 entered.
Secondary CPU 201 entered.
Secondary CPU 65 entered.
Secondary CPU 177 entered.
Secondary CPU 47 entered.
Secondary CPU 210 entered.
Secondary CPU 86 entered.
Secondary CPU 35 entered.
Secondary CPU 180 entered.
Secondary CPU 103 entered.
Secondary CPU 98 entered.
Secondary CPU 108 entered.
Secondary CPU 118 entered.
Secondary CPU 119 entered.
Secondary CPU 128 entered.
Secondary CPU 95 entered.
Secondary CPU 58 entered.
Secondary CPU 33 entered.
Secondary CPU 122 entered.
Secondary CPU 185 entered.
Secondary CPU 215 entered.
Secondary CPU 37 entered.
Secondary CPU 197 entered.
[INFO][17] Hypervisor header: HvHeader {
    signature: [
        0x48,
        0x59,
        0x50,
        0x45,
        0x52,
        0x45,
        0x4e,
        0x43,
    ],
    core_size: 0x811000,
    percpu_size: 0x81000,
    entry: 0x24be30,
    version: 0x10401,
    max_cpus: 0xe0,
    online_cpus: 0xe0,
    arm_linux_hyp_vectors: 0x0,
    arm_linux_hyp_abi: 0x0,
    tpm_type: 0x0,
    tpm_mmio_size: 0x5000,
    tpm_mmio_pa: 0xfed40000,
    he_log_pa: 0xf9fd200000,
    vmm_anomaly_cpus_pa: 0x1fc6f31a800,
    feature_mask: HHBOX_LOG | HHBOX_CRASH | 0x0x200,
    hv_heap_size: 0x23f800000,
    conv_mem_ranges: [
        MemRange {
            start: 0x0,
            size: 0x3e000,
        },
        MemRange {
            start: 0x3f000,
            size: 0x61000,
        },
        MemRange {
            start: 0x100000,
            size: 0x69edf000,
        },
        MemRange {
            start: 0x777ff000,
            size: 0x1000,
        },
        MemRange {
            start: 0x100000000,
            size: 0x1ff80000000,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
    ],
       nr_conv_mem: 0x5,
    init_epc_ranges: [
        MemRange {
            start: 0x780000000,
            size: 0x1980000000,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
        MemRange {
            start: 0x0,
            size: 0x0,
        },
    ],
    nr_init_epc: 0x1,
}
Secondary CPU 33 entered.
Secondary CPU 49 entered.
Secondary CPU 10 entered.
[DEBUG][31] System config: HvSystemConfig {
    hypervisor_memory: HvMemoryRegion {
        phys_start: 0x100000000,
        virt_start: 0xffffff0000000000,
        size: 0x680000000,
        flags: (empty),
    },
    platform_info: PlatformInfo {
        arch: ArchPlatformInfo {
            iommu_units: [
                HvIommuInfo {
                    base: 0xdf3fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xe7ffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xf0bfc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xf97fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xd67fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xf9ffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xfa7fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xfaffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xfb7fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xa97fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xb4bfc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xbfffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xcaffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xcb7fc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xcbffc000,
                    size: 0x1000,
                },
                HvIommuInfo {
                    base: 0xcc7fc000,
                    size: 0x1000,
                },
            ],
            rmrr_ranges: [
                HvRmrrRange {
                    base: 0x76d14000,
                    limit: 0x76d35fff,
                },
                HvRmrrRange {
                    base: 0x0,
                    limit: 0x0,
                },
                HvRmrrRange {
                    base: 0x0,
                    limit: 0x0,
                },
                HvRmrrRange {
                    base: 0x0,
                    limit: 0x0,
                },
            ],
        },
    },
    num_memory_regions: 0x45,
}
Secondary CPU 158 entered.
Secondary CPU 63 entered.
Secondary CPU 163 entered.
Secondary CPU 51 entered.
Secondary CPU 138 entered.
Secondary CPU 60 entered.
Secondary CPU 103 entered.
Secondary CPU 43 entered.
Secondary CPU 48 entered.
Secondary CPU 154 entered.
Secondary CPU 152 entered.
Secondary CPU 35 entered.
Secondary CPU 131 entered.
Secondary CPU 54 entered.
Secondary CPU 197 entered.
Secondary CPU 170 entered.
Secondary CPU 58 entered.
reclaim crypto algorithm: EncSWHmacSW
Secondary CPU 166 entered.
Secondary CPU 110 entered.
Secondary CPU 147 entered.
Secondary CPU 46 entered.
Secondary CPU 36 entered.
Secondary CPU 135 entered.
Secondary CPU 23 entered.
Secondary CPU 115 entered.
Secondary CPU 33 entered.
Secondary CPU 164 entered.
Secondary CPU 145 entered.
Secondary CPU 42 entered.
Secondary CPU 215 entered.
Secondary CPU 69 entered.
Secondary CPU 118 entered.
Secondary CPU 55 entered.
Secondary CPU 49 entered.
Secondary CPU 3 entered.
Secondary CPU 37 entered.
Secondary CPU 116 entered.
Secondary CPU 146 entered.
Secondary CPU 181 entered.
Secondary CPU 148 entered.
Secondary CPU 172 entered.
Secondary CPU 151 entered.
[INFO][31] Finish heap allocator init, va range: 0xffffff00078f2000..0xffffff02470f2000, pa range: 0x1078f2000..0x3470f2000
Secondary CPU 52 entered.
[INFO][31] Finish cmrm range init, va range: 0xffffff02470f2000..0xffffff0547cf2000, pa range: 0x3470f2000..0x647cf2000
Secondary CPU 117 entered.
Secondary CPU 5 entered.
[INFO][31] Finish frame allocator init, va range: 0xffffff0547cf2000..0xffffff0680000000, pa range: 0x647cf2000..0x780000000
Secondary CPU 4 entered.
[INFO][31] Mapping hypervisor memory: start=0x100000000, size=0x680000000
[INFO][31] Finished hypervisor memory map: start=0x100000000, size=0x680000000
[INFO][31] map epc to empty page in gpm, epc_range: [0x780000000, 0x20ffffffff], 0x1980000000
[INFO][31] Finished map epc to empty page in gpm, epc_range: [0x780000000, 0x20ffffffff], 0x1980000000
tpm mmio is mapped va=0xfed40000
hvm.insert va=0xfffffeff00001000
normal_world_mem_region.insert phys_start=0x1000
hvm.insert va=0xfffffeff0003f000
normal_world_mem_region.insert phys_start=0x3f000
hvm.insert va=0xfffffeff00100000
normal_world_mem_region.insert phys_start=0x100000
hvm.insert va=0xfffffeff777ff000
normal_world_mem_region.insert phys_start=0x777ff000
hvm.insert va=0xffffff2000000000
[DEBUG][31] failed to map page: 0xc0000000(Size1G) -> 0x101c0000000, AlreadyMapped((3221225472, 26975256576, READ | WRITE | EXECUTE | USER, Size1G))
[DEBUG][31] Drop MemorySet {
    regions: [
        MemoryRegion {
            vaddr_range: 0x1000..0x3e000,
            size: 0x3d000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x3f000..0xa0000,
            size: 0x61000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x100000..0x69fdf000,
            size: 0x69edf000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x70277000..0x777ff000,
            size: 0x7588000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x777ff000..0x77800000,
            size: 0x1000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x2100000000..0x20080000000,
            size: 0x1df80000000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
    ],
    page_table: "rust_hypervisor::memory::paging::Level4PageTable<usize, rust_hypervisor::arch::vmm::vendor::vtd::IoPTEntry, rust_hypervisor::memory::paging::EmptyPagingInstr>",
    page_table_root: 0x647cf4000,
}
[DEBUG][31] Drop MemorySet {
    regions: [
        MemoryRegion {
            vaddr_range: 0xfed40000..0xfed45000,
            size: 0x5000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfffffeff00001000..0xfffffeff0003e000,
            size: 0x3d000,
            flags: READ | WRITE,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfffffeff0003f000..0xfffffeff000a0000,
            size: 0x61000,
            flags: READ | WRITE,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfffffeff00100000..0xfffffeff69fdf000,
            size: 0x69edf000,
            flags: READ | WRITE,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfffffeff777ff000..0xfffffeff77800000,
            size: 0x1000,
            flags: READ | WRITE,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xffffff0000000000..0xffffff0000811000,
            size: 0x811000,
            flags: READ | WRITE | EXECUTE | ENCRYPTED,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xffffff00078f1000..0xffffff0680000000,
            size: 0x67870f000,
            flags: READ | WRITE | ENCRYPTED,
            mapper: Offset(
                0xfffffeff00000000,
            ),
        },
    ],
    page_table: "rust_hypervisor::memory::paging::Level4PageTable<usize, rust_hypervisor::arch::page_table::PTEntry, rust_hypervisor::arch::page_table::X86PagingInstr>",
    page_table_root: 0x647cf3000,
}
[DEBUG][31] Drop MemorySet {
    regions: [
        MemoryRegion {
            vaddr_range: 0x0..0x1000,
            size: 0x1000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x1000..0x3e000,
            size: 0x3d000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x3e000..0x3f000,
            size: 0x1000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x3f000..0xa0000,
            size: 0x61000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xa0000..0x100000,
            size: 0x60000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x100000..0x69fdf000,
            size: 0x69edf000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x69fdf000..0x6c0df000,
            size: 0x2100000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x6c0df000..0x6c9df000,
            size: 0x900000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x6c9df000..0x70277000,
            size: 0x3898000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x70277000..0x777ff000,
            size: 0x7588000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x777ff000..0x77800000,
            size: 0x1000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x77800000..0x90000000,
            size: 0x18800000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x90040000..0x9e400000,
            size: 0xe3c0000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x9e400000..0xa9800000,
            size: 0xb400000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xa9800000..0xb4c00000,
            size: 0xb400000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xb4c00000..0xc0000000,
            size: 0xb400000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xc0000000..0xcb000000,
            size: 0xb000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xcb000000..0xcb800000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xcb800000..0xcc000000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xcc000000..0xcc800000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xcc800000..0xcd000000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xcd800000..0xd6800000,
            size: 0x9000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xd6800000..0xdf400000,
            size: 0x8c00000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xdf400000..0xe8000000,
            size: 0x8c00000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xe8000000..0xf0c00000,
            size: 0x8c00000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xf0c00000..0xf9800000,
            size: 0x8c00000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xf9800000..0xfa000000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfa000000..0xfa800000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfa800000..0xfb000000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfb000000..0xfb800000,
            size: 0x800000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd690000..0xfd6a0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6a0000..0xfd6b0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6b0000..0xfd6c0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6c0000..0xfd6d0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6d0000..0xfd6e0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6e0000..0xfd6f0000,
            size: 0x10000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfd6f0000..0xfe000000,
            size: 0x910000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfe010000..0xfe011000,
            size: 0x1000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfe03e000..0xfe03f000,
            size: 0x1000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfe03f000..0xfe040000,
            size: 0x1000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfe200000..0xfe800000,
            size: 0x600000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfec00000..0xfed00000,
            size: 0x100000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfed00000..0xfed01000,
            size: 0x1000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfed40000..0xfed45000,
            size: 0x5000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xfee00000..0xfee01000,
            size: 0x1000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0xff000000..0x100000000,
            size: 0x1000000,
            flags: READ | WRITE | EXECUTE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x100000000..0x780000000,
            size: 0x680000000,
            flags: READ | ENCRYPTED,
            mapper: Fixed(
                0x100600000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x780000000..0x2100000000,
            size: 0x1980000000,
            flags: READ | ENCRYPTED,
            mapper: Fixed(
                0x100600000,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x2100000000..0x20080000000,
            size: 0x1df80000000,
            flags: READ | WRITE | EXECUTE | DMA,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x200000000000..0x201000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x201000000000..0x202000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x202000000000..0x203000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x203000000000..0x204000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x204000000000..0x205000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x205000000000..0x206000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x206000000000..0x206100000000,
            size: 0x100000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x206100000000..0x206500000000,
            size: 0x400000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x206500000000..0x207000000000,
            size: 0xb00000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x207000000000..0x208000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x208000000000..0x209000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x209000000000..0x20a000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20a000000000..0x20b000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20b000000000..0x20c000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20c000000000..0x20d000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20d000000000..0x20e000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20e000000000..0x20f000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20f000000000..0x20f100000000,
            size: 0x100000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20f100000000..0x20f500000000,
            size: 0x400000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x20f500000000..0x210000000000,
            size: 0xb00000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x210000000000..0x211000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
        MemoryRegion {
            vaddr_range: 0x211000000000..0x212000000000,
            size: 0x1000000000,
            flags: READ | WRITE,
            mapper: Offset(
                0x0,
            ),
        },
    ],
    page_table: "rust_hypervisor::memory::paging::Level4PageTable<usize, rust_hypervisor::arch::vmm::vendor::ept::EPTEntry, rust_hypervisor::arch::vmm::vendor::ept::EPTInstr>",
    page_table_root: 0x647cf2000,
}
[ERROR][31]
panicked at 'called `Result::unwrap()` on an `Err` value: [src/memory/paging.rs:46:18] Bad address: AlreadyMapped((3221225472, 26975256576, READ | WRITE | EXECUTE | USER, Size1G))', src/cell.rs:233:55
Current Cpu: PerCpu {
    cpu_id:

[Bonjourz]

Hi @bronzeMe , try to use fake TPM and see whether error still exists.

[bronzeMe]

try to use fake TPM and see whether error still exists.

测试过了，使用Fake TPM还是一样的错误的 @Bonjourz

[Bonjourz]

Hi @bronzeMe ,

we are considering support memory larger than 1 TB now.

The root cause of log:

panicked at 'called `Result::unwrap()` on an `Err` value: [src/memory/paging.rs:46:18] Bad address: AlreadyMapped((3221225472, 26975256576, READ | WRITE | EXECUTE | USER, Size1G))', src/cell.rs:233:55

is: the virtual address used by TPM conflicts with other virtual address. We have provided workaround for this issue.

Please pull the newest code, and then apply your changes. Notice that this workaround only works under FAKE TPM mode.

[bronzeMe]

we are considering support memory larger than 1 TB now.
@Bonjourz 测试了一下最新提交的workaround 补丁，在fake tpm和物理TPM下都没有成功，你们有计划什么时候发布正式补丁么？谢谢

[Bonjourz]

@bronzeMe ,

as stated here:

Notice that this workaround only works under FAKE TPM mode

Currently we do not have available hardware which is equipped with 2TB memory.

You may need to show us the log(FAKE TPM mode) so that we can further solve the problems.