Many
Manuals
search
Categories
Brands
Home
Chelsio Communications
Software
Chelsio T5
User's Guide
Chelsio Communications Chelsio T5 User's Guide Page 176
Download
Share
Sharing
Add to my manuals
Print
Page
/
460
Table of contents
TROUBLESHOOTING
BOOKMARKS
Rated
.
/ 5. Based on
customer reviews
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
Chapter X
.
FCoE
PDU Offload Ta
rget
Chelsio T5/T4 Uni
fied Wire For Linux
Page 176
4.
Soft
w
are/Driver Unloading
To unload the driv
er, run the follow
ing command:
[root@host]# modprobe
–
r chfcoe
1
2
...
171
172
173
174
175
176
177
178
179
180
181
...
459
460
Document History
3
TABLE OF CONTENTS
4
I. CHELSIO UNIFIED WIRE 12
4
II. NETWORK (NIC/TOE) 47
4
IV. IWARP (RDMA) 64
5
V. WD-UDP 80
5
VI. WD-TOE 91
5
vii
7
XVI. BYPASS DRIVER 216
8
XXI. UNIFIED BOOT 387
10
XXIII. APPENDIX A 455
11
I. Chelsio Unified Wire
12
1. Introduction
13
1.2. Hardware Requirements
14
1.4. Package Contents
14
Page 15
15
1.4.2. RPM package
16
2. Hardware Installation
17
Page 18
18
Page 19
19
Configuration
20
Tuning Option
20
Description
20
Driver/Software installed
20
3.1. Pre-requisites
21
Page 22
22
Page 23
23
Page 24
24
Page 25
25
[root@host]# ./install.py
26
[root@host]#./install.py –h
27
3.2.3. CLI mode
28
Page 29
29
Page 30
30
Page 31
31
3.3.1. Menu Mode
32
3.3.2. CLI mode
33
[root@host]# ./install.py –h
34
3.4. Firmware update
35
Page 37
37
4.1.3. CLI mode
38
Page 39
39
Page 40
40
Page 41
41
Page 42
42
Page 43
43
Page 44
44
5.4. Checking Link
45
6. Software/Driver Update
46
II. Network (NIC/TOE)
47
4.2. Performance tuning
52
Page 53
53
Page 54
54
[root@host]# ethtool -h
55
Page 56
56
Page 57
57
Page 58
58
Page 63
63
IV. iWARP (RDMA)
64
Page 66
66
[root@host]# make
67
[root@host]# make install
67
Page 69
69
4.2. Enabling various MPIs
70
Intel-MPI
71
Page 72
72
Page 73
73
Page 74
74
Page 75
75
4.2.4. Building MPI tests
76
Page 77
77
4.3. Setting up NFS-RDMA
78
Page 79
79
V. WD-UDP
80
Page 82
82
Page 85
85
4.1.2. Using libcxgb4_sock
86
Page 87
87
Page 88
88
Page 89
89
Page 90
90
VI. WD-TOE
91
Page 93
93
Page 96
96
Page 97
97
1.2.2. Adapter Requirements
100
1.2.3. Storage Requirements
100
1.3. Software Requirements
101
Page 102
102
2. Software/Driver Loading
103
Page 104
104
Page 105
105
2.3.1. Linux Requirements
106
Page 107
107
3. Software/Driver Unloading
108
4.1. Command Line Tools
109
Page 110
110
4.3.2. Basic iSCSI Control
111
Page 112
112
Page 113
113
specifies
119
Page 121
121
Page 122
122
Page 123
123
Page 124
124
4.6.1. ACL Enforcement
125
4.7.1. RAM Disk Details
126
Page 127
127
Page 128
128
4.9.1. iscsictl
129
4.9.2. chisns
129
4.9.3. iscsictl options
130
4.11.1. iscsi_offload_mode
135
4.11.2. iscsi_auth_order
136
Page 137
137
1.2. Software Requirements
139
Page 141
141
Page 143
143
4.1.3. Discovery and Login
144
Page 145
145
Page 146
146
Page 147
147
Page 151
151
Page 152
152
Page 153
153
Page 154
154
Page 155
155
Page 156
156
X. FCoE PDU Offload Target
157
Page 159
159
Page 160
160
Page 162
162
Page 163
163
Page 164
164
Page 165
165
Page 166
166
Page 167
167
Page 168
168
Page 169
169
Page 170
170
Page 171
171
Page 172
172
3.6. Removing LUNs
173
3.7. Performance tuning
173
Page 174
174
Page 175
175
4. Software/Driver Unloading
176
Page 177
177
4.2.1. Verifying Local Ports
181
Page 182
182
Page 183
183
Page 184
184
[root@host]# lsscsi –g
185
Page 186
186
4.4. Creating Filesystem
187
Page 188
188
XII. Offload Bonding driver
189
Page 191
191
Page 194
194
Page 195
195
Page 200
200
Page 201
201
Page 202
202
1.1. Hardware Requirements
204
*Limited QA Performed
205
Page 208
208
Page 209
209
4.2. Configuring UDP Pacing
210
XV. Offload IPv6 driver
211
Page 213
213
XVI. Bypass Driver
216
4.1. Starting ba server
222
4.2. Bypass API (CLI)
222
4.2.3. Bypass State
223
4.2.5. Redirect Management
224
Command
225
Page 227
227
Page 228
228
1. Theory of Operation
229
2. Installation and Usage
232
Page 233
233
Page 234
234
2. Usage
237
2.2.1. Examples
238
2.3. Listing Filter Rules
239
2.4. Removing Filter Rules
239
2.5. Layer 3 example
240
Page 241
241
Page 242
242
2.6. Layer 2 example
243
Page 244
244
Page 245
245
Page 246
246
3. Hash/DDR Filters
247
3.2. Listing Filter Rules
248
3.3. Removing Filter Rules
249
3.4. Swap MAC feature
249
3.5. Hit Counters
250
Page 251
251
XIX. Traffic Management
252
4.1.1. Class Rate Limiting
257
Page 258
258
Page 259
259
Page 260
260
Page 261
261
5. Usage
262
Page 263
263
Page 264
264
1.2. Reference Architecture
266
CLI Client
267
Web GUI Client
267
2. Hardware and Software
268
2.3. Platform/Driver Matrix
269
Page 270
270
Page 271
271
Page 272
272
5. Management Agent
273
5.4. Firewall
274
6. CLI client
275
7. Web GUI client
276
Page 277
277
Page 278
278
Page 279
279
7.3. Layout and Navigation
280
7.4. Home page
281
Page 282
282
Service Discovery
283
Bulk Driver Installation
284
7.4.2. Add System
285
7.4.3. Remove System
286
7.4.4. Refresh
286
7.4.6. Bulk Configuration
287
Manage Groups
288
Boot Configuration
289
Network Configuration
290
Card Configuration
291
Port Configuration
292
Bypass Configuration
293
7.5. System page
294
7.5.2. Drivers Installation
295
Page 296
296
7.5.3. Driver Details
297
7.5.4. System Diagnostics
298
[root@host]# rmmod kvm
299
[root@host]# rmmod cxgb4
299
[root@host]# modprobe cxgb4
300
Page 301
301
Page 302
302
7.5.9. Xen Configurations
303
7.5.10. Xen VF Properties
304
Page 305
305
7.6. Network page
306
Page 307
307
Page 308
308
Page 309
309
Card statistics
310
Port summary
311
Port settings
312
Port statistics
313
Page 314
314
Page 315
315
System network statistics
316
Page 317
317
Page 318
318
Page 319
319
Network troubleshooting
320
Page 321
321
7.6.3.1. Hypervisor
322
Xen Bridge Configuration
322
Page 323
323
Page 324
324
Page 325
325
Page 326
326
Page 327
327
Page 328
328
7.6.4. iWARP
329
iWARP Settings
329
Page 330
330
Page 331
331
7.6.5. Wire Direct
332
Page 333
333
Page 334
334
7.7. Storage Page
335
Page 336
336
7.7.1.2. FCoE Port
337
FCoE Port Summary
337
FCoE Port Attributes
338
FCoE NPIV management
339
7.7.1.3. FCoE Remote Port
340
Page 341
341
7.7.1.4. FCoE Virtual Port
342
FCoE Virtual Port Summary
342
Page 343
343
Page 344
344
Initiator nodes
345
Page 346
346
Page 347
347
Discover targets
348
Page 349
349
Targets
350
Page 351
351
FO iSCSI Manage Ports
352
Page 353
353
FO iSCSI Manage Instances
354
FO iSCSI Discover Details
355
FO iSCSI Session Details
356
Page 357
357
7.7.4. iSCSI Target (Linux)
358
Target Stack Globals
358
Target properties
359
Page 360
360
Session details
361
New Target Creation
362
7.7.5. LUNs
363
Add LUN
364
7.7.6. Portal Groups
365
Add Portal
366
7.7.7. ACLs
367
Add ACL
368
7.8. Hardware Features
369
Page 370
370
Page 371
371
7.8.3. Boot
372
Page 373
373
T5/T4 Boot Configuration
374
Page 375
375
Page 376
376
Page 377
377
Page 378
378
Page 379
379
7.8.4. Bypass
380
Redirect Configuration
381
Page 382
382
Page 383
383
Egress Queue Map
384
Egress Packet Scheduler
384
Page 385
385
Page 386
386
XXI. Unified Boot
387
2.1. Using Flash Utility
390
C:\CHELSIO>cfut4 –l
391
Page 392
392
Page 393
393
2.2. Using cxgbtool
394
3. Configuring PXE Server
395
4. PXE boot process
396
Page 397
397
Page 398
398
Page 399
399
Page 400
400
5. FCoE boot process
401
Page 402
402
Page 403
403
Page 404
404
Page 405
405
Page 406
406
Page 407
407
Page 408
408
Page 409
409
6. iSCSI boot process
410
Page 411
411
Page 412
412
Page 413
413
Page 414
414
Page 415
415
Page 416
416
Page 417
417
Page 418
418
Page 419
419
Page 420
420
Page 421
421
Page 422
422
Page 423
423
Page 424
424
8. OS Installation
425
Page 426
426
Page 427
427
Page 428
428
Page 429
429
Page 430
430
Page 431
431
Page 432
432
Page 433
433
Page 434
434
8.2.1. Using CD/DVD ROM
435
Page 436
436
Page 437
437
Page 438
438
Page 439
439
8.3.1. Using CD/DVD ROM
440
Page 441
441
Page 442
442
Page 443
443
Page 444
444
Page 445
445
Page 446
446
Page 447
447
Page 448
448
Chapter XXI. Unified Boot
449
XXII. Lustre File System
450
Page 453
453
Page 454
454
XXIII. Appendix A
455
1. Troubleshooting
456
Page 457
457
Chapter XXIII. Appendix
458
Comments to this Manuals
No comments
Publish
Related products and manuals for Software Chelsio Communications Chelsio T5
Software Chelsio Communications Chelsio T5 User's Guide
(452 pages)
Software Chelsio Communications Chelsio T4 User's Guide
(374 pages)
Print document
Print page 176
Comments to this Manuals