thr3ads.net - Xen devel - e820_host and 3G limit [Oct 2012]

If this information is useful, please help other people find it:
Share via:

Fan, Huaxiang

2012-Oct-19 03:40 UTC

e820_host and 3G limit

Hi,

I was told e820_host is used to solve 3G limit on domu problem when PCI passthru
happens. But I failed to tackle this problem using xen 4.2 and kernel 3.4.4

Here is my environment:
Xen hypervisor and tools: 4.2
Dom0 kernel 2.6.32.57
Domu kernel 3.4.4
All above is 64bit

Here is my domu cfg:
kernel = "/root/domainWCG.kernel"
ramdisk = "/root/domainWCG.initrd.img"
e820_host=1
memory=5120
name = "wcg"
vif  = [ ''ip=169.254.254.1,vifname=wcg.0'' ]
disk = [''phy:/dev/lv_appliance/wcg,xvda1,w'',
        ''phy:/dev/sdb,xvdb,w'']
root  = "/dev/xvda1 ro"
extra="iommu=soft printk.printk_time=1 console=hvc0"
#pci=[''01:00.0'',''01:00.1'']
vcpus=4
cpus="4,5,6,7"

Here is the output on dom0:
# xl list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  1677     2     r-----    2237.9
wcg                                         72  4086     4     -b----      34.9

My question#1:
Dom0 memory has been shrink from 2048 to 1677. Wcg domu only allocated with 4086
even I assigned 5120. Why?

Here is the output on wcg domu:
# cat /proc/meminfo | head -10
MemTotal:        2999156 kB
MemFree:         2919760 kB
Buffers:            4000 kB
Cached:            40656 kB
SwapCached:            0 kB
Active:            22852 kB
Inactive:          31776 kB
Active(anon):      10080 kB
Inactive(anon):       12 kB
Active(file):      12772 kB

My question#2:
Why the domu kernel only recognizes 3G memory even I actually allocate 5G to it?

Appendix
E820 memory map on wcg domu

[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 00000000bf699000 (usable)
[    0.000000]  Xen: 00000000bf699000 - 00000000bf6af000 (reserved)
[    0.000000]  Xen: 00000000bf6af000 - 00000000bf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000bf6ce000 - 00000000c0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)

E820 memory map on dom0
BIOS-provided physical RAM map:
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009d000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000100000 - 00000000bf699000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf699000 - 00000000bf6af000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6af000 - 00000000bf6ce000
(ACPI data)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6ce000 - 00000000c0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000fe000000 - 0000000100000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000100000000 - 0000000240000000
(usable)

I am looking forward your reply. Thanks in advance.
HUAXIANG FAN
Software Engineer II

WEBSENSE NETWORK SECURITY TECHNOLOGY R&D (BEIJING) CO. LTD.
ph: +8610.5884.4327
fax: +8610.5884.4727
www.websense.cn<http://www.websense.cn>

Websense TRITON(tm)
For Essential Information Protection(tm)
Web
Security<http://www.websense.com/content/Regional/SCH/WebSecurityOverview.aspx>
| Data
Security<http://www.websense.com/content/Regional/SCH/DataSecurity.aspx> |
Email
Security<http://www.websense.com/content/Regional/SCH/MessagingSecurity.aspx>



 Protected by Websense Hosted Email Security -- www.websense.com 


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Fan, Huaxiang

2012-Oct-19 03:40 UTC

head link

e820_host and 3G limit

Hi,

I was told e820_host is used to solve 3G limit on domu problem when PCI passthru
happens. But I failed to tackle this problem using xen 4.2 and kernel 3.4.4

Here is my environment:
Xen hypervisor and tools: 4.2
Dom0 kernel 2.6.32.57
Domu kernel 3.4.4
All above is 64bit

Here is my domu cfg:
kernel = "/root/domainWCG.kernel"
ramdisk = "/root/domainWCG.initrd.img"
e820_host=1
memory=5120
name = "wcg"
vif  = [ ''ip=169.254.254.1,vifname=wcg.0'' ]
disk = [''phy:/dev/lv_appliance/wcg,xvda1,w'',
        ''phy:/dev/sdb,xvdb,w'']
root  = "/dev/xvda1 ro"
extra="iommu=soft printk.printk_time=1 console=hvc0"
#pci=[''01:00.0'',''01:00.1'']
vcpus=4
cpus="4,5,6,7"

Here is the output on dom0:
# xl list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  1677     2     r-----    2237.9
wcg                                         72  4086     4     -b----      34.9

My question#1:
Dom0 memory has been shrink from 2048 to 1677. Wcg domu only allocated with 4086
even I assigned 5120. Why?

Here is the output on wcg domu:
# cat /proc/meminfo | head -10
MemTotal:        2999156 kB
MemFree:         2919760 kB
Buffers:            4000 kB
Cached:            40656 kB
SwapCached:            0 kB
Active:            22852 kB
Inactive:          31776 kB
Active(anon):      10080 kB
Inactive(anon):       12 kB
Active(file):      12772 kB

My question#2:
Why the domu kernel only recognizes 3G memory even I actually allocate 5G to it?

Appendix
E820 memory map on wcg domu

[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 00000000bf699000 (usable)
[    0.000000]  Xen: 00000000bf699000 - 00000000bf6af000 (reserved)
[    0.000000]  Xen: 00000000bf6af000 - 00000000bf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000bf6ce000 - 00000000c0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)

E820 memory map on dom0
BIOS-provided physical RAM map:
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009d000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000100000 - 00000000bf699000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf699000 - 00000000bf6af000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6af000 - 00000000bf6ce000
(ACPI data)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6ce000 - 00000000c0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000fe000000 - 0000000100000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000100000000 - 0000000240000000
(usable)

I am looking forward your reply. Thanks in advance.
HUAXIANG FAN
Software Engineer II

WEBSENSE NETWORK SECURITY TECHNOLOGY R&D (BEIJING) CO. LTD.
ph: +8610.5884.4327
fax: +8610.5884.4727
www.websense.cn<http://www.websense.cn>

Websense TRITON(tm)
For Essential Information Protection(tm)
Web
Security<http://www.websense.com/content/Regional/SCH/WebSecurityOverview.aspx>
| Data
Security<http://www.websense.com/content/Regional/SCH/DataSecurity.aspx> |
Email
Security<http://www.websense.com/content/Regional/SCH/MessagingSecurity.aspx>



 Protected by Websense Hosted Email Security -- www.websense.com 


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.xen.org/xen-users

Fan, Huaxiang

2012-Oct-24 06:05 UTC

head link

Re: e820_host and 3G limit

Hi,
I''ve tried latest stable kernel 3.6.3 without any luck ):
Thanks for your attention in advance.
Huaxiang

From: xen-devel-bounces@lists.xen.org [mailto:xen-devel-bounces@lists.xen.org]
On Behalf Of Fan, Huaxiang
Sent: Friday, October 19, 2012 11:40 AM
To: xen-devel@lists.xen.org
Cc: xen-users@lists.xen.org
Subject: [Xen-devel] e820_host and 3G limit

Hi,

I was told e820_host is used to solve 3G limit on domu problem when PCI passthru
happens. But I failed to tackle this problem using xen 4.2 and kernel 3.4.4

Here is my environment:
Xen hypervisor and tools: 4.2
Dom0 kernel 2.6.32.57
Domu kernel 3.4.4
All above is 64bit

Here is my domu cfg:
kernel = "/root/domainWCG.kernel"
ramdisk = "/root/domainWCG.initrd.img"
e820_host=1
memory=5120
name = "wcg"
vif  = [ ''ip=169.254.254.1,vifname=wcg.0'' ]
disk = [''phy:/dev/lv_appliance/wcg,xvda1,w'',
        ''phy:/dev/sdb,xvdb,w'']
root  = "/dev/xvda1 ro"
extra="iommu=soft printk.printk_time=1 console=hvc0"
#pci=[''01:00.0'',''01:00.1'']
vcpus=4
cpus="4,5,6,7"

Here is the output on dom0:
# xl list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  1677     2     r-----    2237.9
wcg                                         72  4086     4     -b----      34.9

My question#1:
Dom0 memory has been shrink from 2048 to 1677. Wcg domu only allocated with 4086
even I assigned 5120. Why?

Here is the output on wcg domu:
# cat /proc/meminfo | head -10
MemTotal:        2999156 kB
MemFree:         2919760 kB
Buffers:            4000 kB
Cached:            40656 kB
SwapCached:            0 kB
Active:            22852 kB
Inactive:          31776 kB
Active(anon):      10080 kB
Inactive(anon):       12 kB
Active(file):      12772 kB

My question#2:
Why the domu kernel only recognizes 3G memory even I actually allocate 5G to it?

Appendix
E820 memory map on wcg domu

[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 00000000bf699000 (usable)
[    0.000000]  Xen: 00000000bf699000 - 00000000bf6af000 (reserved)
[    0.000000]  Xen: 00000000bf6af000 - 00000000bf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000bf6ce000 - 00000000c0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)

E820 memory map on dom0
BIOS-provided physical RAM map:
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009d000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000100000 - 00000000bf699000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf699000 - 00000000bf6af000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6af000 - 00000000bf6ce000
(ACPI data)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6ce000 - 00000000c0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000fe000000 - 0000000100000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000100000000 - 0000000240000000
(usable)

I am looking forward your reply. Thanks in advance.
HUAXIANG FAN
Software Engineer II

WEBSENSE NETWORK SECURITY TECHNOLOGY R&D (BEIJING) CO. LTD.
ph: +8610.5884.4327
fax: +8610.5884.4727
www.websense.cn<http://webdefence.global.blackspider.com/urlwrap/?q=AXicY3RmuMjNwHBHhYGhKKfSwCJJr7ioTC83MTMnOT-vpCg_Ry85P5eh0NLLOK3cJNDAyMLY3IghozQtMc-hPDWpODWvOBWsIqOkpMBKX7-8vFwPIZ7HAACXox8q&Z>

Websense TRITON(tm)
For Essential Information Protection(tm)
Web
Security<http://www.websense.com/content/Regional/SCH/WebSecurityOverview.aspx>
| Data
Security<http://www.websense.com/content/Regional/SCH/DataSecurity.aspx> |
Email
Security<http://www.websense.com/content/Regional/SCH/MessagingSecurity.aspx>


Protected by Websense Hosted Email Security -
www.websense.com<http://www.websense.com>


Click
here<https://www.mailcontrol.com/sr/2nvMiXRJ7hrGX2PQPOmvUkHxlm0SZLPCKmkxSqt7dtICdVcISuJAdnxwVRnwzYbEazL7zkoF0KGURD1dro2FIg==>
to report this email as spam.


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.xen.org/xen-users

Fan, Huaxiang

2012-Oct-24 06:05 UTC

head link

Re: e820_host and 3G limit

Hi,
I''ve tried latest stable kernel 3.6.3 without any luck ):
Thanks for your attention in advance.
Huaxiang

From: xen-devel-bounces@lists.xen.org [mailto:xen-devel-bounces@lists.xen.org]
On Behalf Of Fan, Huaxiang
Sent: Friday, October 19, 2012 11:40 AM
To: xen-devel@lists.xen.org
Cc: xen-users@lists.xen.org
Subject: [Xen-devel] e820_host and 3G limit

Hi,

I was told e820_host is used to solve 3G limit on domu problem when PCI passthru
happens. But I failed to tackle this problem using xen 4.2 and kernel 3.4.4

Here is my environment:
Xen hypervisor and tools: 4.2
Dom0 kernel 2.6.32.57
Domu kernel 3.4.4
All above is 64bit

Here is my domu cfg:
kernel = "/root/domainWCG.kernel"
ramdisk = "/root/domainWCG.initrd.img"
e820_host=1
memory=5120
name = "wcg"
vif  = [ ''ip=169.254.254.1,vifname=wcg.0'' ]
disk = [''phy:/dev/lv_appliance/wcg,xvda1,w'',
        ''phy:/dev/sdb,xvdb,w'']
root  = "/dev/xvda1 ro"
extra="iommu=soft printk.printk_time=1 console=hvc0"
#pci=[''01:00.0'',''01:00.1'']
vcpus=4
cpus="4,5,6,7"

Here is the output on dom0:
# xl list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  1677     2     r-----    2237.9
wcg                                         72  4086     4     -b----      34.9

My question#1:
Dom0 memory has been shrink from 2048 to 1677. Wcg domu only allocated with 4086
even I assigned 5120. Why?

Here is the output on wcg domu:
# cat /proc/meminfo | head -10
MemTotal:        2999156 kB
MemFree:         2919760 kB
Buffers:            4000 kB
Cached:            40656 kB
SwapCached:            0 kB
Active:            22852 kB
Inactive:          31776 kB
Active(anon):      10080 kB
Inactive(anon):       12 kB
Active(file):      12772 kB

My question#2:
Why the domu kernel only recognizes 3G memory even I actually allocate 5G to it?

Appendix
E820 memory map on wcg domu

[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  Xen: 00000000000a0000 - 0000000000100000 (reserved)
[    0.000000]  Xen: 0000000000100000 - 00000000bf699000 (usable)
[    0.000000]  Xen: 00000000bf699000 - 00000000bf6af000 (reserved)
[    0.000000]  Xen: 00000000bf6af000 - 00000000bf6ce000 (ACPI data)
[    0.000000]  Xen: 00000000bf6ce000 - 00000000c0000000 (reserved)
[    0.000000]  Xen: 00000000e0000000 - 00000000f0000000 (reserved)
[    0.000000]  Xen: 00000000fe000000 - 0000000100000000 (reserved)

E820 memory map on dom0
BIOS-provided physical RAM map:
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009d000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000000100000 - 00000000bf699000
(usable)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf699000 - 00000000bf6af000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6af000 - 00000000bf6ce000
(ACPI data)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000bf6ce000 - 00000000c0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 00000000fe000000 - 0000000100000000
(reserved)
Oct 18 05:26:34 localhost kernel: BIOS-e820: 0000000100000000 - 0000000240000000
(usable)

I am looking forward your reply. Thanks in advance.
HUAXIANG FAN
Software Engineer II

WEBSENSE NETWORK SECURITY TECHNOLOGY R&D (BEIJING) CO. LTD.
ph: +8610.5884.4327
fax: +8610.5884.4727
www.websense.cn<http://webdefence.global.blackspider.com/urlwrap/?q=AXicY3RmuMjNwHBHhYGhKKfSwCJJr7ioTC83MTMnOT-vpCg_Ry85P5eh0NLLOK3cJNDAyMLY3IghozQtMc-hPDWpODWvOBWsIqOkpMBKX7-8vFwPIZ7HAACXox8q&Z>

Websense TRITON(tm)
For Essential Information Protection(tm)
Web
Security<http://www.websense.com/content/Regional/SCH/WebSecurityOverview.aspx>
| Data
Security<http://www.websense.com/content/Regional/SCH/DataSecurity.aspx> |
Email
Security<http://www.websense.com/content/Regional/SCH/MessagingSecurity.aspx>


Protected by Websense Hosted Email Security -
www.websense.com<http://www.websense.com>


Click
here<https://www.mailcontrol.com/sr/2nvMiXRJ7hrGX2PQPOmvUkHxlm0SZLPCKmkxSqt7dtICdVcISuJAdnxwVRnwzYbEazL7zkoF0KGURD1dro2FIg==>
to report this email as spam.


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Xen devel - Oct 2012 - e820_host and 3G limit

e820_host and 3G limit

e820_host and 3G limit

Re: e820_host and 3G limit

Re: e820_host and 3G limit