Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-16 Thread Michal Hocko
On Thu 15-04-21 15:31:46, Tim Chen wrote: > > > On 4/9/21 12:24 AM, Michal Hocko wrote: > > On Thu 08-04-21 13:29:08, Shakeel Butt wrote: > >> On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: > > [...] > >>> The low priority jobs should be able to be restricted by cpuset, for > >>> example, just

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-15 Thread Tim Chen
On 4/9/21 12:24 AM, Michal Hocko wrote: > On Thu 08-04-21 13:29:08, Shakeel Butt wrote: >> On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: > [...] >>> The low priority jobs should be able to be restricted by cpuset, for >>> example, just keep them on second tier memory nodes. Then all the >>>

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-15 Thread Tim Chen
On 4/8/21 10:18 AM, Shakeel Butt wrote: > > Using v1's soft limit like behavior can potentially cause high > priority jobs to stall to make enough space on top tier memory on > their allocation path and I think this patchset is aiming to reduce > that impact by making kswapd do that work.

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-14 Thread Tim Chen
On 4/12/21 12:20 PM, Shakeel Butt wrote: >> >> memory_t0.current Current usage of tier 0 memory by the cgroup. >> >> memory_t0.min If tier 0 memory used by the cgroup falls below this >> low >> boundary, the memory will not be subjected to >> demotion

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-14 Thread Tim Chen
On 4/8/21 1:29 PM, Shakeel Butt wrote: > On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: > > The low and min limits have semantics similar to the v1's soft limit > for this situation i.e. letting the low priority job occupy top tier > memory and depending on reclaim to take back the excess

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-14 Thread Jonathan Cameron
On Mon, 12 Apr 2021 12:20:22 -0700 Shakeel Butt wrote: > On Fri, Apr 9, 2021 at 4:26 PM Tim Chen wrote: > > > > > > On 4/8/21 4:52 AM, Michal Hocko wrote: > > > > >> The top tier memory used is reported in > > >> > > >> memory.toptier_usage_in_bytes > > >> > > >> The amount of top tier memory

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-13 Thread Michal Hocko
On Fri 09-04-21 16:26:53, Tim Chen wrote: > > On 4/8/21 4:52 AM, Michal Hocko wrote: > > >> The top tier memory used is reported in > >> > >> memory.toptier_usage_in_bytes > >> > >> The amount of top tier memory usable by each cgroup without > >> triggering page reclaim is controlled by the > >>

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-12 Thread Huang, Ying
Tim Chen writes: > On 4/8/21 4:52 AM, Michal Hocko wrote: > >>> The top tier memory used is reported in >>> >>> memory.toptier_usage_in_bytes >>> >>> The amount of top tier memory usable by each cgroup without >>> triggering page reclaim is controlled by the >>> >>>

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-12 Thread Shakeel Butt
On Fri, Apr 9, 2021 at 4:26 PM Tim Chen wrote: > > > On 4/8/21 4:52 AM, Michal Hocko wrote: > > >> The top tier memory used is reported in > >> > >> memory.toptier_usage_in_bytes > >> > >> The amount of top tier memory usable by each cgroup without > >> triggering page reclaim is controlled by

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-12 Thread Shakeel Butt
On Thu, Apr 8, 2021 at 4:52 AM Michal Hocko wrote: > [...] > > What I am trying to say (and I have brought that up when demotion has been > discussed at LSFMM) is that the implementation shouldn't be PMEM aware. > The specific technology shouldn't be imprinted into the interface. > Fundamentally

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-12 Thread Shakeel Butt
On Thu, Apr 8, 2021 at 1:50 PM Yang Shi wrote: > [...] > > > > The low and min limits have semantics similar to the v1's soft limit > > for this situation i.e. letting the low priority job occupy top tier > > memory and depending on reclaim to take back the excess top tier > > memory use of such

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-09 Thread Tim Chen
On 4/8/21 4:52 AM, Michal Hocko wrote: >> The top tier memory used is reported in >> >> memory.toptier_usage_in_bytes >> >> The amount of top tier memory usable by each cgroup without >> triggering page reclaim is controlled by the >> >> memory.toptier_soft_limit_in_bytes > Michal, Thanks

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-09 Thread Yang Shi
On Thu, Apr 8, 2021 at 7:58 PM Huang, Ying wrote: > > Yang Shi writes: > > > On Thu, Apr 8, 2021 at 10:19 AM Shakeel Butt wrote: > >> > >> Hi Tim, > >> > >> On Mon, Apr 5, 2021 at 11:08 AM Tim Chen > >> wrote: > >> > > >> > Traditionally, all memory is DRAM. Some DRAM might be closer/faster

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-09 Thread Michal Hocko
On Thu 08-04-21 13:29:08, Shakeel Butt wrote: > On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: [...] > > The low priority jobs should be able to be restricted by cpuset, for > > example, just keep them on second tier memory nodes. Then all the > > above problems are gone. Yes, if the aim is to

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Huang, Ying
Yang Shi writes: > On Thu, Apr 8, 2021 at 10:19 AM Shakeel Butt wrote: >> >> Hi Tim, >> >> On Mon, Apr 5, 2021 at 11:08 AM Tim Chen wrote: >> > >> > Traditionally, all memory is DRAM. Some DRAM might be closer/faster than >> > others NUMA wise, but a byte of media has about the same cost

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Yang Shi
On Thu, Apr 8, 2021 at 1:29 PM Shakeel Butt wrote: > > On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: > > > > On Thu, Apr 8, 2021 at 10:19 AM Shakeel Butt wrote: > > > > > > Hi Tim, > > > > > > On Mon, Apr 5, 2021 at 11:08 AM Tim Chen > > > wrote: > > > > > > > > Traditionally, all memory is

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Shakeel Butt
On Thu, Apr 8, 2021 at 11:01 AM Yang Shi wrote: > > On Thu, Apr 8, 2021 at 10:19 AM Shakeel Butt wrote: > > > > Hi Tim, > > > > On Mon, Apr 5, 2021 at 11:08 AM Tim Chen wrote: > > > > > > Traditionally, all memory is DRAM. Some DRAM might be closer/faster than > > > others NUMA wise, but a

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Yang Shi
On Thu, Apr 8, 2021 at 10:19 AM Shakeel Butt wrote: > > Hi Tim, > > On Mon, Apr 5, 2021 at 11:08 AM Tim Chen wrote: > > > > Traditionally, all memory is DRAM. Some DRAM might be closer/faster than > > others NUMA wise, but a byte of media has about the same cost whether it > > is close or far.

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Shakeel Butt
Hi Tim, On Mon, Apr 5, 2021 at 11:08 AM Tim Chen wrote: > > Traditionally, all memory is DRAM. Some DRAM might be closer/faster than > others NUMA wise, but a byte of media has about the same cost whether it > is close or far. But, with new memory tiers such as Persistent Memory > (PMEM).

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-08 Thread Michal Hocko
On Wed 07-04-21 15:33:26, Tim Chen wrote: > > > On 4/6/21 2:08 AM, Michal Hocko wrote: > > On Mon 05-04-21 10:08:24, Tim Chen wrote: > > [...] > >> To make fine grain cgroup based management of the precious top tier > >> DRAM memory possible, this patchset adds a few new features: > >> 1.

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-07 Thread Tim Chen
On 4/6/21 2:08 AM, Michal Hocko wrote: > On Mon 05-04-21 10:08:24, Tim Chen wrote: > [...] >> To make fine grain cgroup based management of the precious top tier >> DRAM memory possible, this patchset adds a few new features: >> 1. Provides memory monitors on the amount of top tier memory used

Re: [RFC PATCH v1 00/11] Manage the top tier memory in a tiered memory

2021-04-06 Thread Michal Hocko
On Mon 05-04-21 10:08:24, Tim Chen wrote: [...] > To make fine grain cgroup based management of the precious top tier > DRAM memory possible, this patchset adds a few new features: > 1. Provides memory monitors on the amount of top tier memory used per cgroup >and by the system as a whole. >