xref: /openbmc/u-boot/doc/README.fsl-ddr (revision c66f5620)
1Table of interleaving 2-4 controllers
2=====================================
3  +--------------+-----------------------------------------------------------+
4  |Configuration |                    Memory Controller                      |
5  |              |       1              2              3             4       |
6  |--------------+--------------+--------------+-----------------------------+
7  | Two memory   | Not Intlv'ed | Not Intlv'ed |                             |
8  | complexes    +--------------+--------------+                             |
9  |              |      2-way Intlv'ed         |                             |
10  |--------------+--------------+--------------+--------------+              |
11  |              | Not Intlv'ed | Not Intlv'ed | Not Intlv'ed |              |
12  | Three memory +--------------+--------------+--------------+              |
13  | complexes    |         2-way Intlv'ed      | Not Intlv'ed |              |
14  |              +-----------------------------+--------------+              |
15  |              |                  3-way Intlv'ed            |              |
16  +--------------+--------------+--------------+--------------+--------------+
17  |              | Not Intlv'ed | Not Intlv'ed | Not Intlv'ed | Not Intlv'ed |
18  | Four memory  +--------------+--------------+--------------+--------------+
19  | complexes    |       2-way Intlv'ed        |       2-way Intlv'ed        |
20  |              +-----------------------------+-----------------------------+
21  |              |                      4-way Intlv'ed                       |
22  +--------------+-----------------------------------------------------------+
23
24
25Table of 2-way interleaving modes supported in cpu/8xxx/ddr/
26======================================================
27  +-------------+---------------------------------------------------------+
28  |		|		    Rank Interleaving			  |
29  |		+--------+-----------+-----------+------------+-----------+
30  |Memory	|	 |	     |		 |    2x2     |    4x1	  |
31  |Controller	|  None  | 2x1 lower | 2x1 upper | {CS0+CS1}, | {CS0+CS1+ |
32  |Interleaving |	 | {CS0+CS1} | {CS2+CS3} | {CS2+CS3}  |  CS2+CS3} |
33  +-------------+--------+-----------+-----------+------------+-----------+
34  |None		|  Yes	 | Yes	     | Yes	 | Yes	      | Yes	  |
35  +-------------+--------+-----------+-----------+------------+-----------+
36  |Cacheline	|  Yes	 | Yes	     | No	 | No, Only(*)| Yes	  |
37  |		|CS0 Only|	     |		 | {CS0+CS1}  |		  |
38  +-------------+--------+-----------+-----------+------------+-----------+
39  |Page		|  Yes	 | Yes	     | No	 | No, Only(*)| Yes	  |
40  |		|CS0 Only|	     |		 | {CS0+CS1}  |		  |
41  +-------------+--------+-----------+-----------+------------+-----------+
42  |Bank		|  Yes	 | Yes	     | No	 | No, Only(*)| Yes	  |
43  |		|CS0 Only|	     |		 | {CS0+CS1}  |		  |
44  +-------------+--------+-----------+-----------+------------+-----------+
45  |Superbank	|  No	 | Yes	     | No	 | No, Only(*)| Yes	  |
46  |		|	 |	     |		 | {CS0+CS1}  |		  |
47  +-------------+--------+-----------+-----------+------------+-----------+
48 (*) Although the hardware can be configured with memory controller
49 interleaving using "2x2" rank interleaving, it only interleaves {CS0+CS1}
50 from each controller. {CS2+CS3} on each controller are only rank
51 interleaved on that controller.
52
53 For memory controller interleaving, identical DIMMs are suggested. Software
54 doesn't check the size or organization of interleaved DIMMs.
55
56The ways to configure the ddr interleaving mode
57==============================================
581. In board header file(e.g.MPC8572DS.h), add default interleaving setting
59   under "CONFIG_EXTRA_ENV_SETTINGS", like:
60	#define CONFIG_EXTRA_ENV_SETTINGS				\
61	 "hwconfig=fsl_ddr:ctlr_intlv=bank"			\
62	 ......
63
642. Run U-Boot "setenv" command to configure the memory interleaving mode.
65   Either numerical or string value is accepted.
66
67  # disable memory controller interleaving
68  setenv hwconfig "fsl_ddr:ctlr_intlv=null"
69
70  # cacheline interleaving
71  setenv hwconfig "fsl_ddr:ctlr_intlv=cacheline"
72
73  # page interleaving
74  setenv hwconfig "fsl_ddr:ctlr_intlv=page"
75
76  # bank interleaving
77  setenv hwconfig "fsl_ddr:ctlr_intlv=bank"
78
79  # superbank
80  setenv hwconfig "fsl_ddr:ctlr_intlv=superbank"
81
82  # 1KB 3-way interleaving
83  setenv hwconfig "fsl_ddr:ctlr_intlv=3way_1KB"
84
85  # 4KB 3-way interleaving
86  setenv hwconfig "fsl_ddr:ctlr_intlv=3way_4KB"
87
88  # 8KB 3-way interleaving
89  setenv hwconfig "fsl_ddr:ctlr_intlv=3way_8KB"
90
91  # disable bank (chip-select) interleaving
92  setenv hwconfig "fsl_ddr:bank_intlv=null"
93
94  # bank(chip-select) interleaving cs0+cs1
95  setenv hwconfig "fsl_ddr:bank_intlv=cs0_cs1"
96
97  # bank(chip-select) interleaving cs2+cs3
98  setenv hwconfig "fsl_ddr:bank_intlv=cs2_cs3"
99
100  # bank(chip-select) interleaving (cs0+cs1) and (cs2+cs3)  (2x2)
101  setenv hwconfig "fsl_ddr:bank_intlv=cs0_cs1_and_cs2_cs3"
102
103  # bank(chip-select) interleaving (cs0+cs1+cs2+cs3) (4x1)
104  setenv hwconfig "fsl_ddr:bank_intlv=cs0_cs1_cs2_cs3"
105
106  # bank(chip-select) interleaving (auto)
107  setenv hwconfig "fsl_ddr:bank_intlv=auto"
108  This auto mode only select from cs0_cs1_cs2_cs3, cs0_cs1, null dependings
109  on DIMMs.
110
111Memory controller address hashing
112==================================
113If the DDR controller supports address hashing, it can be enabled by hwconfig.
114
115Syntax is:
116hwconfig=fsl_ddr:addr_hash=true
117
118Memory controller ECC on/off
119============================
120If ECC is enabled in board configuratoin file, i.e. #define CONFIG_DDR_ECC,
121ECC can be turned on/off by hwconfig.
122
123Syntax is
124hwconfig=fsl_ddr:ecc=off
125
126
127Memory address parity on/off
128============================
129address parity can be turned on/off by hwconfig.
130Syntax is:
131hwconfig=fsl_ddr:parity=on
132
133
134Memory testing options for mpc85xx
135==================================
1361. Memory test can be done once U-Boot prompt comes up using mtest, or
1372. Memory test can be done with Power-On-Self-Test function, activated at
138   compile time.
139
140   In order to enable the POST memory test, CONFIG_POST needs to be
141   defined in board configuraiton header file. By default, POST memory test
142   performs a fast test. A slow test can be enabled by changing the flag at
143   compiling time. To test memory bigger than 2GB, 36BIT support is needed.
144   Memory is tested within a 2GB window. TLBs are used to map the virtual 2GB
145   window to physical address so that all physical memory can be tested.
146
147Combination of hwconfig
148=======================
149Hwconfig can be combined with multiple parameters, for example, on a supported
150platform
151
152hwconfig=fsl_ddr:addr_hash=true,ctlr_intlv=cacheline,bank_intlv=cs0_cs1_cs2_cs3,ecc=on
153
154
155Table for dynamic ODT for DDR3
156==============================
157For single-slot system with quad-rank DIMM and dual-slot system, dynamic ODT may
158be needed, depending on the configuration. The numbers in the following tables are
159in Ohms.
160
161* denotes dynamic ODT
162
163Two slots system
164+-----------------------+----------+---------------+-----------------------------+-----------------------------+
165|     Configuration	|	   |DRAM controller|	       Slot 1		 |	      Slot 2	       |
166+-----------+-----------+----------+-------+-------+--------------+--------------+--------------+--------------+
167|	    |		|	   |	   |	   |	 Rank 1   |	Rank 2	 |   Rank 1	|    Rank 2    |
168+  Slot 1   |	Slot 2	|Write/Read| Write | Read  |-------+------+-------+------+-------+------+-------+------+
169|	    |		|	   |	   |	   | Write | Read | Write | Read | Write | Read | Write | Read |
170+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
171|	    |		|  Slot 1  |  off  | 75    | 120   | off  | off   | off  | off	 | off	| 30	| 30   |
172| Dual Rank | Dual Rank |----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
173|	    |		|  Slot 2  |  off  | 75    | off   | off  | 30	  | 30	 | 120	 | off	| off	| off  |
174+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
175|	    |		|  Slot 1  |  off  | 75    | 120   | off  | off   | off  | 20	 | 20	|	|      |
176| Dual Rank |Single Rank|----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
177|	    |		|  Slot 2  |  off  | 75    | off   | off  | 20	  | 20	 | 120	*| off	|	|      |
178+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
179|	    |		|  Slot 1  |  off  | 75    | 120  *| off  |	  |	 | off	 | off	| 20	| 20   |
180|Single Rank| Dual Rank |----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
181|	    |		|  Slot 2  |  off  | 75    | 20    | 20   |	  |	 | 120	 | off	| off	| off  |
182+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
183|	    |		|  Slot 1  |  off  | 75    | 120  *| off  |	  |	 | 30	 | 30	|	|      |
184|Single Rank|Single Rank|----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
185|	    |		|  Slot 2  |  off  | 75    | 30    | 30   |	  |	 | 120	*| off	|	|      |
186+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
187| Dual Rank |	Empty	|  Slot 1  |  off  | 75    | 40    | off  | off   | off  |	 |	|	|      |
188+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
189|   Empty   | Dual Rank |  Slot 2  |  off  | 75    |	   |	  |	  |	 | 40	 | off	| off	| off  |
190+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
191|Single Rank|	Empty	|  Slot 1  |  off  | 75    | 40    | off  |	  |	 |	 |	|	|      |
192+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
193|   Empty   |Single Rank|  Slot 2  |  off  | 75    |	   |	  |	  |	 | 40	 | off	|	|      |
194+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
195
196Single slot system
197+-------------+------------+---------------+-----------------------------+-----------------------------+
198|	      |		   |DRAM controller|	 Rank 1   |    Rank 2	 |    Rank 3	|    Rank 4    |
199|Configuration| Write/Read |-------+-------+-------+------+-------+------+-------+------+-------+------+
200|	      |		   | Write | Read  | Write | Read | Write | Read | Write | Read | Write | Read |
201+-------------+------------+-------+-------+-------+------+-------+------+-------+------+-------+------+
202|	      |   R1	   | off   | 75    | 120  *| off  | off   | off  | 20	 | 20	| off	| off  |
203|	      |------------+-------+-------+-------+------+-------+------+-------+------+-------+------+
204|	      |   R2	   | off   | 75    | off   | 20   | 120   | off  | 20	 | 20	| off	| off  |
205|  Quad Rank  |------------+-------+-------+-------+------+-------+------+-------+------+-------+------+
206|	      |   R3	   | off   | 75    | 20    | 20   | off   | off  | 120	*| off	| off	| off  |
207|	      |------------+-------+-------+-------+------+-------+------+-------+------+-------+------+
208|	      |   R4	   | off   | 75    | 20    | 20   | off   | off  | off	 | 20	| 120	| off  |
209+-------------+------------+-------+-------+-------+------+-------+------+-------+------+-------+------+
210|	      |   R1	   | off   | 75    | 40    | off  | off   | off  |
211|  Dual Rank  |------------+-------+-------+-------+------+-------+------+
212|	      |   R2	   | off   | 75    | 40    | off  | off   | off  |
213+-------------+------------+-------+-------+-------+------+-------+------+
214| Single Rank |   R1	   | off   | 75    | 40    | off  |
215+-------------+------------+-------+-------+-------+------+
216
217Reference http://www.xrosstalkmag.com/mag_issues/xrosstalk_oct08_final.pdf
218	  http://download.micron.com/pdf/technotes/ddr3/tn4108_ddr3_design_guide.pdf
219
220
221Table for ODT for DDR2
222======================
223Two slots system
224+-----------------------+----------+---------------+-----------------------------+-----------------------------+
225|     Configuration     |          |DRAM controller|           Slot 1            |            Slot 2           |
226+-----------+-----------+----------+-------+-------+--------------+--------------+--------------+--------------+
227|           |           |          |       |       |     Rank 1   |     Rank 2   |   Rank 1     |    Rank 2    |
228+  Slot 1   |   Slot 2  |Write/Read| Write | Read  |-------+------+-------+------+-------+------+-------+------+
229|           |           |          |       |       | Write | Read | Write | Read | Write | Read | Write | Read |
230+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
231|           |           |  Slot 1  |  off  | 150   | off   | off  | off   | off  | 75    | 75   | off   | off  |
232| Dual Rank | Dual Rank |----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
233|           |           |  Slot 2  |  off  | 150   | 75    | 75   | off   | off  | off   | off  | off   | off  |
234+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
235|           |           |  Slot 1  |  off  | 150   | off   | off  | off   | off  | 75    | 75   |       |      |
236| Dual Rank |Single Rank|----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
237|           |           |  Slot 2  |  off  | 150   | 75    | 75   | off   | off  | off   | off  |       |      |
238+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
239|           |           |  Slot 1  |  off  | 150   | off   | off  |       |      | 75    | 75   | off   | off  |
240|Single Rank| Dual Rank |----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
241|           |           |  Slot 2  |  off  | 150   | 75    | 75   |       |      | off   | off  | off   | off  |
242+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
243|           |           |  Slot 1  |  off  | 150   | off   | off  |       |      | 75    | 75   |       |      |
244|Single Rank|Single Rank|----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
245|           |           |  Slot 2  |  off  | 150   | 75    | 75   |       |      | off   | off  |       |      |
246+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
247| Dual Rank |   Empty   |  Slot 1  |  off  | 75    | 150   | off  | off   | off  |       |      |       |      |
248+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
249|   Empty   | Dual Rank |  Slot 2  |  off  | 75    |       |      |       |      | 150   | off  | off   | off  |
250+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
251|Single Rank|   Empty   |  Slot 1  |  off  | 75    | 150   | off  |       |      |       |      |       |      |
252+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
253|   Empty   |Single Rank|  Slot 2  |  off  | 75    |       |      |       |      | 150   | off  |       |      |
254+-----------+-----------+----------+-------+-------+-------+------+-------+------+-------+------+-------+------+
255
256Single slot system
257+-------------+------------+---------------+-----------------------------+
258|             |            |DRAM controller|     Rank 1   |    Rank 2    |
259|Configuration| Write/Read |-------+-------+-------+------+-------+------+
260|             |            | Write | Read  | Write | Read | Write | Read |
261+-------------+------------+-------+-------+-------+------+-------+------+
262|             |   R1       | off   | 75    | 150   | off  | off   | off  |
263|  Dual Rank  |------------+-------+-------+-------+------+-------+------+
264|             |   R2       | off   | 75    | 150   | off  | off   | off  |
265+-------------+------------+-------+-------+-------+------+-------+------+
266| Single Rank |   R1       | off   | 75    | 150   | off  |
267+-------------+------------+-------+-------+-------+------+
268
269Reference http://www.samsung.com/global/business/semiconductor/products/dram/downloads/applicationnote/ddr2_odt_control_200603.pdf
270
271
272Interactive DDR debugging
273===========================
274
275For DDR parameter tuning up and debugging, the interactive DDR debugger can
276be activated by setting the environment variable "ddr_interactive" to any
277value.  (The value of ddr_interactive may have a meaning in the future, but,
278for now, the presence of the variable will cause the debugger to run.)  Once
279activated, U-Boot will show the prompt "FSL DDR>" before enabling the DDR
280controller.  The available commands are printed by typing "help".
281
282Another way to enter the interactive DDR debugger without setting the
283environment variable is to send the 'd' character early during the boot
284process.  To save booting time, no additional delay is added, so the window
285to send the key press is very short -- basically, it is the time before the
286memory controller code starts to run.  For example, when rebooting from
287within U-Boot, the user must press 'd' IMMEDIATELY after hitting enter to
288initiate a 'reset' command.  In case of power on/reset, the user can hold
289down the 'd' key while applying power or hitting the board's reset button.
290
291The example flow of using interactive debugging is
292type command "compute" to calculate the parameters from the default
293type command "print" with arguments to show SPD, options, registers
294type command "edit" with arguments to change any if desired
295type command "copy" with arguments to copy controller/dimm settings
296type command "go" to continue calculation and enable DDR controller
297
298Additional commands to restart the debugging are:
299type command "reset" to reset the board
300type command "recompute" to reload SPD and start over
301
302Note, check "next_step" to show the flow. For example, after edit opts, the
303next_step is STEP_ASSIGN_ADDRESSES. After editing registers, the next_step is
304STEP_PROGRAM_REGS.  Upon issuing command "go", the debugger will program the
305DDR controller with the current setting without further calculation and then
306exit to resume the booting of the machine.
307
308The detail syntax for each commands are
309
310print [c<n>] [d<n>] [spd] [dimmparms] [commonparms] [opts] [addresses] [regs]
311	c<n>		- the controller number, eg. c0, c1
312	d<n>		- the DIMM number, eg. d0, d1
313	spd		- print SPD data
314	dimmparms	- DIMM parameters, calculated from SPD
315	commonparms	- lowest common parameters for all DIMMs
316	opts		- options
317	addresses	- address assignment (not implemented yet)
318	regs		- controller registers
319
320edit <c#> <d#> <spd|dimmparms|commonparms|opts|addresses|regs> <element> <value>
321	c<n>		- the controller number, eg. c0, c1
322	d<n>		- the DIMM number, eg. d0, d1
323	spd		- print SPD data
324	dimmparms	- DIMM parameters, calculated from SPD
325	commonparms	- lowest common parameters for all DIMMs
326	opts		- options
327	addresses	- address assignment (not implemented yet)
328	regs		- controller registers
329	<element>	- name of the modified element
330			  byte number if the object is SPD
331	<value>		- decimal or heximal (prefixed with 0x) numbers
332
333copy <src c#> <src d#> <spd|dimmparms|commonparms|opts|addresses|regs> <dst c#> <dst d#>
334	same as for "edit" command
335	DIMM numbers ignored for commonparms, opts, and regs
336
337reset
338	no arguement	- reset the board
339
340recompute
341	no argument	- reload SPD and start over
342
343compute
344	no argument	- recompute from current next_step
345
346next_step
347	no argument	- show current next_step
348
349help
350	no argument	- print a list of all commands
351
352go
353	no argument	- program memory controller(s) and continue with U-Boot
354
355Examples of debugging flow
356
357	FSL DDR>compute
358	Detected UDIMM UG51U6400N8SU-ACF
359	FSL DDR>print
360	print [c<n>] [d<n>] [spd] [dimmparms] [commonparms] [opts] [addresses] [regs]
361	FSL DDR>print dimmparms
362	DIMM parameters:  Controller=0 DIMM=0
363	DIMM organization parameters:
364	module part name = UG51U6400N8SU-ACF
365	rank_density = 2147483648 bytes (2048 megabytes)
366	capacity = 4294967296 bytes (4096 megabytes)
367	burst_lengths_bitmask = 0C
368	base_addresss = 0 (00000000 00000000)
369	n_ranks = 2
370	data_width = 64
371	primary_sdram_width = 64
372	ec_sdram_width = 0
373	registered_dimm = 0
374	n_row_addr = 15
375	n_col_addr = 10
376	edc_config = 0
377	n_banks_per_sdram_device = 8
378	tCKmin_X_ps = 1500
379	tCKmin_X_minus_1_ps = 0
380	tCKmin_X_minus_2_ps = 0
381	tCKmax_ps = 0
382	caslat_X = 960
383	tAA_ps = 13125
384	caslat_X_minus_1 = 0
385	caslat_X_minus_2 = 0
386	caslat_lowest_derated = 0
387	tRCD_ps = 13125
388	tRP_ps = 13125
389	tRAS_ps = 36000
390	tWR_ps = 15000
391	tWTR_ps = 7500
392	tRFC_ps = 160000
393	tRRD_ps = 6000
394	tRC_ps = 49125
395	refresh_rate_ps = 7800000
396	tIS_ps = 0
397	tIH_ps = 0
398	tDS_ps = 0
399	tDH_ps = 0
400	tRTP_ps = 7500
401	tDQSQ_max_ps = 0
402	tQHS_ps = 0
403	FSL DDR>edit c0 opts ECC_mode 0
404	FSL DDR>edit c0 regs cs0_bnds 0x000000FF
405	FSL DDR>go
406	2 GiB left unmapped
407	4 GiB (DDR3, 64-bit, CL=9, ECC off)
408	       DDR Chip-Select Interleaving Mode: CS0+CS1
409	Testing 0x00000000 - 0x7fffffff
410	Testing 0x80000000 - 0xffffffff
411	Remap DDR 2 GiB left unmapped
412
413	POST memory PASSED
414	Flash: 128 MiB
415	L2:    128 KB enabled
416	Corenet Platform Cache: 1024 KB enabled
417	SERDES: timeout resetting bank 3
418	SRIO1: disabled
419	SRIO2: disabled
420	MMC:  FSL_ESDHC: 0
421	EEPROM: Invalid ID (ff ff ff ff)
422	PCIe1: disabled
423	PCIe2: Root Complex, x1, regs @ 0xfe201000
424	  01:00.0     - 8086:10d3 - Network controller
425	PCIe2: Bus 00 - 01
426	PCIe3: disabled
427	In:    serial
428	Out:   serial
429	Err:   serial
430	Net:   Initializing Fman
431	Fman1: Uploading microcode version 101.8.0
432	e1000: 00:1b:21:81:d2:e0
433	FM1@DTSEC1, FM1@DTSEC2, FM1@DTSEC3, FM1@DTSEC4, FM1@DTSEC5, e1000#0 [PRIME]
434	Warning: e1000#0 MAC addresses don't match:
435	Address in SROM is         00:1b:21:81:d2:e0
436	Address in environment is  00:e0:0c:00:ea:05
437
438	Hit any key to stop autoboot:  0
439	=>
440