Kirill A. Shutemov b35f1819ac
mm: create a separate slab for page->ptl allocation ...
If DEBUG_SPINLOCK and DEBUG_LOCK_ALLOC are enabled spinlock_t on x86_64
is 72 bytes. For page->ptl they will be allocated from kmalloc-96 slab,
so we loose 24 on each. An average system can easily allocate few tens
thousands of page->ptl and overhead is significant.
Let's create a separate slab for page->ptl allocation to solve this.
To make sure that it really works this time, some numbers from my test
machine (just booted, no load):
Before:
# grep '^\(kmalloc-96\|page->ptl\)' /proc/slabinfo
kmalloc-96 31987 32190 128 30 1 : tunables 120 60 8 : slabdata 1073 1073 92
After:
# grep '^\(kmalloc-96\|page->ptl\)' /proc/slabinfo
page->ptl 27516 28143 72 53 1 : tunables 120 60 8 : slabdata 531 531 9
kmalloc-96 3853 5280 128 30 1 : tunables 120 60 8 : slabdata 176 176 0
Note that the patch is useful not only for debug case, but also for
PREEMPT_RT, where spinlock_t is always bloated.
Signed-off-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org >
2014-01-21 16:19:44 -08:00
2013-12-17 09:33:18 -08:00
2013-09-26 14:02:33 -04:00
2013-08-21 09:28:29 +02:00
2013-09-09 11:15:49 -07:00
2013-09-29 21:09:34 +02:00
2013-07-09 10:33:30 -07:00
2013-08-14 13:55:15 +05:30
2014-01-09 09:53:30 +09:00
2013-08-19 14:20:21 +05:30
2013-12-09 14:18:33 +01:00
2014-01-08 12:48:53 +00:00
2013-12-08 13:13:52 +00:00
2013-07-10 11:10:27 -07:00
2013-11-14 08:51:29 +09:00
2014-01-21 10:58:17 -08:00
2013-11-07 19:22:48 -05:00
2013-11-08 14:43:01 -08:00
2013-10-30 20:28:43 -04:00
2013-11-06 23:33:14 -08:00
2013-11-04 19:46:58 -05:00
2013-12-23 14:26:17 -06:00
2014-01-16 14:25:37 +01:00
2014-01-21 10:58:17 -08:00
2013-12-23 18:34:58 -08:00
2013-09-10 13:03:41 -07:00
2013-10-24 11:11:39 +01:00
2014-01-13 13:47:23 +01:00
2013-12-12 14:27:57 +01:00
2013-10-02 15:40:57 -04:00
2013-10-28 15:21:32 -04:00
2014-01-13 15:55:19 -08:00
2013-12-08 18:01:56 -08:00
2013-11-14 23:20:45 +01:00
2013-07-03 16:31:35 -07:00
2013-07-30 11:53:12 -04:00
2013-11-09 00:16:28 -05:00
2013-09-24 10:35:17 +01:00
2013-12-02 11:24:18 +00:00
2013-07-03 16:07:42 -07:00
2013-10-27 08:40:39 -04:00
2013-10-17 13:31:19 -07:00
2013-07-15 11:07:56 +01:00
2013-11-05 11:15:03 -05:00
2013-12-24 09:35:17 -08:00
2013-11-08 08:59:44 -07:00
2013-10-16 01:16:04 +02:00
2013-09-30 14:31:02 -07:00
2013-11-13 15:45:43 +09:00
2013-11-08 09:08:12 -07:00
2013-11-14 13:41:48 +09:00
2013-10-25 11:56:00 +01:00
2013-10-28 13:33:58 -06:00
2013-11-19 09:25:07 -07:00
2013-11-08 09:04:30 -07:00
2013-07-03 16:07:39 -07:00
2014-01-13 17:32:27 +01:00
2013-09-04 09:23:46 -04:00
2013-08-30 23:44:11 -07:00
2013-07-09 16:30:35 -07:00
2013-09-23 21:44:16 -04:00
2013-08-19 12:27:17 -07:00
2013-10-07 23:13:33 -07:00
2013-10-02 11:33:23 +02:00
2013-07-30 11:24:20 -07:00
2013-11-15 09:32:23 +09:00
2013-07-30 11:11:44 +02:00
2013-11-13 15:45:43 +09:00
2013-10-11 07:39:14 +02:00
2013-12-10 15:01:01 -08:00
2014-01-12 10:37:17 +01:00
2013-11-15 09:32:21 +09:00
2014-01-10 16:27:36 -08:00
2013-12-02 20:43:15 +01:00
2013-12-02 20:43:14 +01:00
2013-11-09 00:16:29 -05:00
2013-10-23 10:10:20 -07:00
2013-07-08 10:13:40 -04:00
2013-09-13 15:09:52 +02:00
2013-11-14 13:41:48 +09:00
2013-12-08 01:04:17 +01:00
2013-10-30 01:21:24 +01:00
2013-11-06 12:40:27 +01:00
2014-01-15 14:19:42 +07:00
2013-11-03 23:04:56 -05:00
2013-09-07 12:56:26 +10:00
2013-12-12 10:39:01 -08:00
2013-10-03 16:14:12 -07:00
2013-08-18 17:39:55 -07:00
2013-11-15 16:47:22 -08:00
2013-09-20 10:36:34 -04:00
2014-01-13 14:05:13 -08:00
2013-08-02 12:33:54 -07:00
2013-08-27 09:18:29 +02:00
2014-01-21 16:19:41 -08:00
2013-10-31 14:49:24 +00:00
2014-01-14 21:28:39 +00:00
2013-10-23 10:10:12 -07:00
2013-07-06 14:09:38 -07:00
2013-12-11 18:06:47 +01:00
2014-01-05 12:34:29 +01:00
2013-07-03 13:25:24 +02:00
2013-11-09 00:16:24 -05:00
2013-11-09 00:16:23 -05:00
2013-07-15 11:25:00 +09:30
2013-09-26 15:06:58 -07:00
2013-09-07 19:54:57 -04:00
2013-10-29 09:43:37 +10:30
2013-09-27 09:37:01 +09:00
2013-08-26 20:15:23 +09:00
2013-10-29 12:53:04 +02:00
2013-09-26 15:06:58 -07:00
2013-09-26 15:06:58 -07:00
2013-10-07 15:16:45 -04:00
2013-07-27 20:24:36 +02:00
2013-12-08 18:22:32 -08:00
2013-08-22 22:13:54 -07:00
2013-09-12 10:12:47 -07:00
2013-11-15 22:04:17 -05:00
2013-09-27 18:40:25 +01:00
2013-09-27 18:40:25 +01:00
2014-01-21 16:19:41 -08:00
2013-11-19 16:57:40 +01:00
2013-11-05 17:43:40 -05:00
2013-11-13 12:09:22 +09:00
2013-11-19 16:39:06 -05:00
2013-07-09 10:33:21 -07:00
2013-11-25 09:03:39 +01:00
2014-01-13 17:32:27 +01:00
2013-10-11 17:21:14 +11:00
2013-08-30 08:42:01 +10:00
2013-12-02 21:05:30 +00:00
2013-12-24 10:30:57 -08:00
2013-09-13 15:11:21 +02:00
2013-08-26 21:40:24 +02:00
2013-09-26 15:06:58 -07:00
2013-10-31 09:55:48 +01:00
2014-01-21 16:19:43 -08:00
2014-01-21 16:19:43 -08:00
2013-10-13 16:16:26 -07:00
2013-10-13 16:16:28 -07:00
2013-09-29 18:27:03 -07:00
2014-01-16 11:15:50 +01:00
2014-01-14 17:11:13 +01:00
2013-08-26 09:30:03 -07:00
2013-10-16 18:40:57 -07:00
2013-10-28 15:05:28 +01:00
2013-11-15 17:55:48 -05:00
2013-07-23 16:52:47 -07:00
2013-11-11 00:42:07 -05:00
2013-07-23 16:52:47 -07:00
2013-09-26 15:06:58 -07:00
2014-01-13 13:41:50 +01:00
2013-12-10 22:58:13 -08:00
2013-09-24 13:04:07 +02:00
2013-11-15 09:32:22 +09:00
2013-09-25 11:07:04 +02:00
2013-11-03 10:53:11 -08:00
2013-12-05 20:31:40 -05:00
2013-11-13 16:03:02 +01:00
2013-12-19 17:43:04 +00:00
2013-09-13 15:09:52 +02:00
2013-11-19 19:06:41 +01:00
2013-07-01 08:12:41 -04:00
2013-08-09 10:49:00 +02:00
2013-08-20 11:46:54 -07:00
2013-10-19 19:45:35 -04:00
2014-01-08 15:23:53 +00:00
2013-07-26 16:19:48 -07:00
2013-10-03 18:47:54 +02:00
2013-09-13 15:09:52 +02:00
2013-11-13 12:09:07 +09:00
2014-01-20 10:22:12 -08:00
2014-01-17 11:50:07 -08:00
2013-12-07 14:20:28 -07:00
2013-09-25 17:17:01 +01:00
2013-09-25 17:17:01 +01:00
2013-11-15 09:32:23 +09:00
2013-10-03 18:47:54 +02:00
2013-08-28 21:35:14 -07:00
2013-12-11 15:28:36 -08:00
2013-09-11 15:58:52 -07:00
2013-07-25 12:35:39 +02:00
2013-11-04 10:20:57 +02:00
2013-07-03 16:07:43 -07:00
2013-11-09 00:16:21 -05:00
2013-12-17 07:03:14 -05:00
2013-09-10 18:56:32 -04:00
2013-11-13 12:09:24 +09:00
2013-11-15 09:32:22 +09:00
2013-11-06 12:40:26 +01:00
2013-12-20 12:25:45 -08:00
2013-09-11 15:59:45 -07:00
2013-12-11 15:52:34 +01:00
2013-08-06 14:10:45 +00:00
2013-11-13 12:09:08 +09:00
2013-10-16 21:35:53 -07:00
2013-11-13 12:09:06 +09:00
2013-12-20 12:20:26 -08:00
2013-11-13 12:09:05 +09:00
2013-12-11 13:54:13 -05:00
2013-12-21 17:56:08 -05:00
2013-11-13 15:27:00 +09:00
2013-09-11 15:58:01 -07:00
2013-12-20 12:25:45 -08:00
2014-01-21 16:19:44 -08:00
2013-11-13 12:09:11 +09:00
2014-01-21 16:19:43 -08:00
2013-09-07 09:48:41 -07:00
2013-09-23 15:44:58 +09:30
2013-08-20 15:37:42 +09:30
2013-11-09 00:16:19 -05:00
2013-11-13 12:09:36 +09:00
2013-11-14 11:28:18 -07:00
2013-11-11 12:41:33 +01:00
2013-08-02 12:33:54 -07:00
2013-11-09 00:16:19 -05:00
2013-07-03 16:08:05 -07:00
2013-12-10 21:45:15 -05:00
2013-11-07 19:11:41 -05:00
2014-01-10 13:23:08 -05:00
2013-09-26 14:48:15 -07:00
2013-09-26 14:48:15 -07:00
2013-09-26 14:48:15 -07:00
2013-10-14 17:15:48 +02:00
2013-10-25 19:26:58 -04:00
2013-12-05 13:05:48 -08:00
2013-10-28 15:37:43 -04:00
2013-11-19 16:20:40 -05:00
2013-10-28 15:38:02 -04:00
2013-07-25 21:54:01 +02:00
2013-08-27 13:52:52 -04:00
2013-09-03 16:40:32 -04:00
2013-10-09 20:04:10 -05:00
2013-08-21 10:29:51 +01:00
2013-10-09 20:03:54 -05:00
2013-10-29 18:26:14 -07:00
2013-11-08 10:47:28 -06:00
2013-10-27 16:26:58 -07:00
2013-08-28 20:50:19 +01:00
2013-10-24 11:50:36 +01:00
2013-11-12 16:52:17 +09:00
2013-08-15 17:22:27 -07:00
2013-11-13 12:09:04 +09:00
2013-09-03 22:52:48 -04:00
2013-10-30 12:02:58 +08:00
2013-10-09 14:47:45 +02:00
2013-10-11 17:24:39 +11:00
2013-07-03 16:07:32 -07:00
2013-07-03 16:07:31 -07:00
2013-11-14 11:28:18 -07:00
2013-09-15 17:41:30 -04:00
2013-11-14 23:17:21 +01:00
2013-12-15 11:56:47 -08:00
2013-11-14 11:28:18 -07:00
2013-10-25 11:56:00 +01:00
2013-12-05 12:59:23 -05:00
2013-11-13 15:17:16 +09:00
2014-01-12 10:16:07 +01:00
2013-11-20 22:09:19 -05:00
2013-10-24 23:43:29 -04:00
2013-07-03 16:08:03 -07:00
2013-09-26 16:18:32 -07:00
2013-10-25 22:33:23 +02:00
2013-07-15 01:31:37 +02:00
2014-01-21 16:19:42 -08:00
2013-07-03 16:16:20 +02:00
2013-12-23 18:21:11 -08:00
2013-10-17 00:36:06 +02:00
2013-08-19 21:22:34 -07:00
2014-01-13 17:32:27 +01:00
2014-01-13 17:38:55 +01:00
2013-10-29 16:50:52 -07:00
2013-12-20 13:12:01 -08:00
2013-07-09 10:33:26 -07:00
2013-10-16 09:05:57 +02:00
2013-08-14 19:54:30 +01:00
2013-08-20 16:53:58 -05:00
2013-08-17 09:32:32 -04:00
2013-09-11 15:59:36 -07:00
2013-09-11 15:59:37 -07:00
2013-11-11 14:32:15 -05:00
2013-11-13 12:09:33 +09:00
2013-12-12 12:34:16 -08:00
2013-12-12 12:35:38 -08:00
2013-12-12 12:34:16 -08:00
2013-12-12 12:34:16 -08:00
2013-12-18 19:04:50 -08:00
2013-10-28 13:01:35 -07:00
2013-09-12 15:38:02 -07:00
2013-07-12 12:07:46 +02:00
2013-07-03 16:08:05 -07:00
2013-07-03 16:08:05 -07:00
2014-01-13 13:41:50 +01:00
2013-12-17 21:19:08 -08:00
2014-01-13 13:47:36 +01:00
2013-12-08 17:56:37 -08:00
2013-10-09 16:54:39 -07:00
2014-01-13 17:38:55 +01:00
2013-10-22 22:26:41 +11:00
2013-07-09 10:33:28 -07:00
2013-11-15 09:32:20 +09:00
2014-01-12 10:13:59 +01:00
2013-10-16 13:16:19 -07:00
2013-09-16 18:19:04 -07:00
2013-10-17 16:41:50 -07:00
2013-08-27 14:25:27 +05:30
2013-08-20 17:10:41 -07:00
2013-08-27 14:25:09 +05:30
2013-12-02 11:24:19 +00:00
2013-09-10 18:56:32 -04:00
2013-09-01 14:16:33 -07:00
2013-12-27 13:04:33 -05:00
2013-11-22 08:10:34 -08:00
2013-11-24 11:01:16 -08:00
2013-11-22 08:10:34 -08:00
2013-11-15 09:32:22 +09:00
2013-08-02 12:33:54 -07:00
2013-08-07 16:52:33 -07:00
2014-01-13 13:47:36 +01:00
2014-01-13 13:47:36 +01:00
2013-12-16 11:36:13 +01:00
2013-11-06 09:32:09 +02:00
2014-01-21 08:28:07 +00:00
2013-08-30 17:26:09 -04:00
2013-10-09 12:40:45 +02:00
2013-09-12 15:38:02 -07:00
2013-11-15 09:32:14 +09:00
2014-01-13 13:41:04 +01:00
2014-01-13 14:05:13 -08:00
2013-10-16 13:01:44 -07:00
2013-07-31 12:16:45 -07:00
2013-08-29 13:54:34 -07:00
2013-11-25 13:34:51 -08:00
2013-09-03 09:10:24 -04:00
2013-10-17 14:38:44 +02:00
2013-09-25 13:53:10 +02:00
2013-12-02 20:43:14 +01:00
2013-10-10 12:31:43 -07:00
2013-09-20 12:03:46 +02:00
2014-01-06 14:37:25 +01:00
2013-11-19 16:57:40 +01:00
2013-12-09 11:09:24 -08:00
2013-12-08 16:56:05 -08:00
2014-01-20 16:13:02 -08:00
2013-11-06 12:40:25 +01:00
2014-01-13 13:47:37 +01:00
2013-11-20 16:31:01 +01:00
2013-10-16 13:32:04 -07:00
2014-01-10 16:54:35 -08:00
2013-09-24 10:35:19 +01:00
2013-07-09 10:33:29 -07:00
2013-08-05 10:52:36 -06:00
2013-08-29 13:30:21 +10:00
2013-10-11 15:19:22 +10:00
2013-10-17 10:55:37 +10:30
2013-10-29 11:28:11 +10:30
2013-10-29 11:28:17 +10:30
2013-11-13 12:09:11 +09:00
2013-07-09 10:33:21 -07:00
2013-12-03 11:15:58 -08:00
2013-09-03 18:25:03 -07:00
2013-09-11 15:58:01 -07:00
2013-12-02 20:43:15 +01:00
2013-11-14 15:16:16 +11:00
2013-07-30 08:30:16 -04:00
2013-11-13 12:09:07 +09:00
2013-07-12 12:07:46 +02:00
2013-07-25 19:30:03 +10:00
2013-10-17 15:53:09 -04:00
2013-07-10 18:11:34 -07:00
2013-11-26 11:09:08 +01:00
b35f1819ac