Chelsio Communications Chelsio T5 manuals

Owner’s manuals and user’s guides for Software Chelsio Communications Chelsio T5.
We providing 2 pdf manuals Chelsio Communications Chelsio T5 for download free by document types: User's Guide


Table of contents

Document History

3

TABLE OF CONTENTS

4

I. CHELSIO UNIFIED WIRE 12

4

II. NETWORK (NIC/TOE) 47

4

IV. IWARP (RDMA) 64

5

V. WD-UDP 80

5

VI. WD-TOE 91

5

vii

7

XVI. BYPASS DRIVER 216

8

XXI. UNIFIED BOOT 387

10

XXIII. APPENDIX A 455

11

I. Chelsio Unified Wire

12

1. Introduction

13

1.2. Hardware Requirements

14

1.4. Package Contents

14

Page 15

15

1.4.2. RPM package

16

2. Hardware Installation

17

Page 18

18

Page 19

19

Configuration

20

Tuning Option

20

Description

20

Driver/Software installed

20

3.1. Pre-requisites

21

Page 22

22

Page 23

23

Page 24

24

Page 25

25

[root@host]# ./install.py

26

[root@host]#./install.py –h

27

3.2.3. CLI mode

28

Page 29

29

Page 30

30

Page 31

31

3.3.1. Menu Mode

32

3.3.2. CLI mode

33

[root@host]# ./install.py –h

34

3.4. Firmware update

35

Page 37

37

4.1.3. CLI mode

38

Page 39

39

Page 40

40

Page 41

41

Page 42

42

Page 43

43

Page 44

44

5.4. Checking Link

45

6. Software/Driver Update

46

II. Network (NIC/TOE)

47

4.2. Performance tuning

52

Page 53

53

Page 54

54

[root@host]# ethtool -h

55

Page 56

56

Page 57

57

Page 58

58

Page 63

63

IV. iWARP (RDMA)

64

Page 66

66

[root@host]# make

67

[root@host]# make install

67

Page 69

69

4.2. Enabling various MPIs

70

Intel-MPI

71

Page 72

72

Page 73

73

Page 74

74

Page 75

75

4.2.4. Building MPI tests

76

Page 77

77

4.3. Setting up NFS-RDMA

78

Page 79

79

V. WD-UDP

80

Page 82

82

Page 85

85

4.1.2. Using libcxgb4_sock

86

Page 87

87

Page 88

88

Page 89

89

Page 90

90

VI. WD-TOE

91

Page 93

93

Page 96

96

Page 97

97

1.2.2. Adapter Requirements

100

1.2.3. Storage Requirements

100

1.3. Software Requirements

101

Page 102

102

2. Software/Driver Loading

103

Page 104

104

Page 105

105

2.3.1. Linux Requirements

106

Page 107

107

3. Software/Driver Unloading

108

4.1. Command Line Tools

109

Page 110

110

4.3.2. Basic iSCSI Control

111

Page 112

112

Page 113

113

specifies

119

Page 121

121

Page 122

122

Page 123

123

Page 124

124

4.6.1. ACL Enforcement

125

4.7.1. RAM Disk Details

126

Page 127

127

Page 128

128

4.9.1. iscsictl

129

4.9.2. chisns

129

4.9.3. iscsictl options

130

4.11.1. iscsi_offload_mode

135

4.11.2. iscsi_auth_order

136

Page 137

137

1.2. Software Requirements

139

Page 141

141

Page 143

143

4.1.3. Discovery and Login

144

Page 145

145

Page 146

146

Page 147

147

Page 151

151

Page 152

152

Page 153

153

Page 154

154

Page 155

155

Page 156

156

X. FCoE PDU Offload Target

157

Page 159

159

Page 160

160

Page 162

162

Page 163

163

Page 164

164

Page 165

165

Page 166

166

Page 167

167

Page 168

168

Page 169

169

Page 170

170

Page 171

171

Page 172

172

3.6. Removing LUNs

173

3.7. Performance tuning

173

Page 174

174

Page 175

175

4. Software/Driver Unloading

176

Page 177

177

4.2.1. Verifying Local Ports

181

Page 182

182

Page 183

183

Page 184

184

[root@host]# lsscsi –g

185

Page 186

186

4.4. Creating Filesystem

187

Page 188

188

XII. Offload Bonding driver

189

Page 191

191

Page 194

194

Page 195

195

Page 200

200

Page 201

201

Page 202

202

1.1. Hardware Requirements

204

*Limited QA Performed

205

Page 208

208

Page 209

209

4.2. Configuring UDP Pacing

210

XV. Offload IPv6 driver

211

Page 213

213

XVI. Bypass Driver

216

4.1. Starting ba server

222

4.2. Bypass API (CLI)

222

4.2.3. Bypass State

223

4.2.5. Redirect Management

224

Command

225

Page 227

227

Page 228

228

1. Theory of Operation

229

2. Installation and Usage

232

Page 233

233

Page 234

234

2. Usage

237

2.2.1. Examples

238

2.3. Listing Filter Rules

239

2.4. Removing Filter Rules

239

2.5. Layer 3 example

240

Page 241

241

Page 242

242

2.6. Layer 2 example

243

Page 244

244

Page 245

245

Page 246

246

3. Hash/DDR Filters

247

3.2. Listing Filter Rules

248

3.3. Removing Filter Rules

249

3.4. Swap MAC feature

249

3.5. Hit Counters

250

Page 251

251

XIX. Traffic Management

252

4.1.1. Class Rate Limiting

257

Page 258

258

Page 259

259

Page 260

260

Page 261

261

5. Usage

262

Page 263

263

Page 264

264

1.2. Reference Architecture

266

CLI Client

267

Web GUI Client

267

2. Hardware and Software

268

2.3. Platform/Driver Matrix

269

Page 270

270

Page 271

271

Page 272

272

5. Management Agent

273

5.4. Firewall

274

6. CLI client

275

7. Web GUI client

276

Page 277

277

Page 278

278

Page 279

279

7.3. Layout and Navigation

280

7.4. Home page

281

Page 282

282

Service Discovery

283

Bulk Driver Installation

284

7.4.2. Add System

285

7.4.3. Remove System

286

7.4.4. Refresh

286

7.4.6. Bulk Configuration

287

Manage Groups

288

Boot Configuration

289

Network Configuration

290

Card Configuration

291

Port Configuration

292

Bypass Configuration

293

7.5. System page

294

7.5.2. Drivers Installation

295

Page 296

296

7.5.3. Driver Details

297

7.5.4. System Diagnostics

298

[root@host]# rmmod kvm

299

[root@host]# rmmod cxgb4

299

[root@host]# modprobe cxgb4

300

Page 301

301

Page 302

302

7.5.9. Xen Configurations

303

7.5.10. Xen VF Properties

304

Page 305

305

7.6. Network page

306

Page 307

307

Page 308

308

Page 309

309

Card statistics

310

Port summary

311

Port settings

312

Port statistics

313

Page 314

314

Page 315

315

System network statistics

316

Page 317

317

Page 318

318

Page 319

319

Network troubleshooting

320

Page 321

321

7.6.3.1. Hypervisor

322

Xen Bridge Configuration

322

Page 323

323

Page 324

324

Page 325

325

Page 326

326

Page 327

327

Page 328

328

7.6.4. iWARP

329

iWARP Settings

329

Page 330

330

Page 331

331

7.6.5. Wire Direct

332

Page 333

333

Page 334

334

7.7. Storage Page

335

Page 336

336

7.7.1.2. FCoE Port

337

FCoE Port Summary

337

FCoE Port Attributes

338

FCoE NPIV management

339

7.7.1.3. FCoE Remote Port

340

Page 341

341

7.7.1.4. FCoE Virtual Port

342

FCoE Virtual Port Summary

342

Page 343

343

Page 344

344

Initiator nodes

345

Page 346

346

Page 347

347

Discover targets

348

Page 349

349

Targets

350

Page 351

351

FO iSCSI Manage Ports

352

Page 353

353

FO iSCSI Manage Instances

354

FO iSCSI Discover Details

355

FO iSCSI Session Details

356

Page 357

357

7.7.4. iSCSI Target (Linux)

358

Target Stack Globals

358

Target properties

359

Page 360

360

Session details

361

New Target Creation

362

7.7.5. LUNs

363

Add LUN

364

7.7.6. Portal Groups

365

Add Portal

366

7.7.7. ACLs

367

Add ACL

368

7.8. Hardware Features

369

Page 370

370

Page 371

371

7.8.3. Boot

372

Page 373

373

T5/T4 Boot Configuration

374

Page 375

375

Page 376

376

Page 377

377

Page 378

378

Page 379

379

7.8.4. Bypass

380

Redirect Configuration

381

Page 382

382

Page 383

383

Egress Queue Map

384

Egress Packet Scheduler

384

Page 385

385

Page 386

386

XXI. Unified Boot

387

2.1. Using Flash Utility

390

C:\CHELSIO>cfut4 –l

391

Page 392

392

Page 393

393

2.2. Using cxgbtool

394

3. Configuring PXE Server

395

4. PXE boot process

396

Page 397

397

Page 398

398

Page 399

399

Page 400

400

5. FCoE boot process

401

Page 402

402

Page 403

403

Page 404

404

Page 405

405

Page 406

406

Page 407

407

Page 408

408

Page 409

409

6. iSCSI boot process

410

Page 411

411

Page 412

412

Page 413

413

Page 414

414

Page 415

415

Page 416

416

Page 417

417

Page 418

418

Page 419

419

Page 420

420

Page 421

421

Page 422

422

Page 423

423

Page 424

424

8. OS Installation

425

Page 426

426

Page 427

427

Page 428

428

Page 429

429

Page 430

430

Page 431

431

Page 432

432

Page 433

433

Page 434

434

8.2.1. Using CD/DVD ROM

435

Page 436

436

Page 437

437

Page 438

438

Page 439

439

8.3.1. Using CD/DVD ROM

440

Page 441

441

Page 442

442

Page 443

443

Page 444

444

Page 445

445

Page 446

446

Page 447

447

Page 448

448

Chapter XXI. Unified Boot

449

XXII. Lustre File System

450

Page 453

453

Page 454

454

XXIII. Appendix A

455

1. Troubleshooting

456

Page 457

457

Chapter XXIII. Appendix

458

Table of contents

Document History

3

TABLE OF CONTENTS

4

I. CHELSIO UNIFIED WIRE 11

4

II. NETWORK (NIC/TOE) 47

4

IV. IWARP (RDMA) 64

5

V. WD-UDP 81

5

VI. WD-TOE 92

5

XIII. BYPASS DRIVER 185

7

viii

8

XVIII.UNIFIED BOOT 339

9

XIX. APPENDIX A 447

10

I. Chelsio Unified Wire

11

1. Introduction

12

1.4. Package Contents

13

Page 14

14

1.4.2. RPM package

15

2. Hardware Installation

16

Page 17

17

Page 18

18

3.1. Pre-requisites

19

[root@host]# ./install.py

20

Page 21

21

Page 22

22

Page 23

23

Page 24

24

Page 25

25

[root@host]#./install.py –h

28

3.2.3. CLI mode

29

Page 30

30

Page 31

31

3.3.1. Menu Mode

32

3.3.2. CLI mode

34

3.4. Firmware update

35

Page 37

37

Page 38

38

4.1.3. CLI mode

39

Page 40

40

Page 41

41

Page 42

42

Page 43

43

Page 44

44

5.3. Checking Link

45

6. Software/Driver Update

46

II. Network (NIC/TOE)

47

4.2. Performance tuning

52

Page 53

53

Page 54

54

[root@host]# ethtool -h

55

Page 56

56

Page 57

57

Page 58

58

Page 63

63

IV. iWARP (RDMA)

64

Page 66

66

Page 69

69

4.2. Enabling various MPIs

70

Intel-MPI

71

Platform MPI Setup

72

Page 73

73

Page 74

74

Page 75

75

Page 76

76

4.2.4. Building MPI tests

77

Page 78

78

4.3. Setting up NFS-RDMA

79

Page 80

80

V. WD-UDP

81

Page 83

83

[root@host]# make

84

[root@host]# make install

84

Page 86

86

4.1.2. Using libcxgb4_sock

87

Page 88

88

Page 89

89

Page 90

90

Page 91

91

VI. WD-TOE

92

Page 94

94

Page 97

97

Page 98

98

1.2. Hardware Requirements

100

1.2.2. Adapter Requirements

101

1.2.3. Storage Requirements

101

1.3. Software Requirements

102

Page 103

103

2. Software/Driver Loading

104

Page 105

105

2.2.1. Linux Requirements

106

Page 107

107

3. Software/Driver Unloading

108

4.1. Command Line Tools

109

Page 110

110

4.3.2. Basic iSCSI Control

111

Page 112

112

Page 113

113

specifies

119

Page 121

121

Page 122

122

Page 123

123

Page 124

124

4.6.1. ACL Enforcement

125

4.7.1. RAM Disk Details

126

Page 127

127

Page 128

128

4.9.1. iscsictl

129

4.9.2. chisns

129

4.9.3. iscsictl options

130

4.11.1. iscsi_offload_mode

135

4.11.2. iscsi_auth_order

136

Page 137

137

1.2. Software Requirements

139

Page 141

141

Page 143

143

4.1.3. Discovery and Login

144

Page 145

145

Page 146

146

Page 147

147

Page 151

151

Page 152

152

Page 153

153

Page 154

154

Page 155

155

Page 156

156

4.2.2. Verifying Local Ports

157

Page 158

158

Page 159

159

Page 160

160

Page 161

161

[root@host]# lsscsi –g

162

Page 163

163

4.4. Creating Filesystem

164

Page 165

165

X. Offload Bonding driver

166

Page 168

168

Page 171

171

Page 172

172

1.1. Hardware Requirements

174

Page 177

177

Page 178

178

4.2. Configuring UDP Pacing

179

XII. Offload IPv6 driver

180

Page 182

182

XIII. Bypass Driver

185

4.1. Starting ba server

191

4.2. Bypass API (CLI)

191

4.2.3. Bypass State

192

4.2.5. Redirect Management

193

Command

194

Page 196

196

XIV. WD Sniffing and Tracing

197

1. Theory of Operation

198

2. Installation and Usage

201

Page 202

202

Page 203

203

Page 205

205

2. Usage

206

2.2.1. Examples

207

2.3. Listing Filter Rules

208

2.4. Removing Filter Rules

208

XVI. Traffic Management

209

4.1.1. Class Rate Limiting

214

Page 215

215

Page 216

216

Page 217

217

Page 218

218

Page 219

219

5. Usage

220

Page 221

221

Page 222

222

1.2. Reference Architecture

224

CLI Client

225

Web GUI Client

225

2. Hardware and Software

226

2.3. Platform/Driver Matrix

227

Chelsio driver

228

Version

228

Page 229

229

Page 230

230

Page 231

231

5. Management Agent

232

5.4. Firewall

233

6. CLI client

234

7. Web GUI client

235

Page 236

236

Page 237

237

7.3. Layout and Navigation

238

7.4. Home page

239

Page 240

240

Service Discovery

241

Bulk Driver Installation

241

Page 242

242

7.4.2. Add System

243

7.4.3. Remove System

243

7.4.4. Refresh

244

7.4.6. Bulk Configuration

245

Manage Groups

246

Boot Configuration

247

Network Configuration

248

Card Configuration

249

Port Configuration

250

Bypass Configuration

251

7.5. System page

252

7.5.2. Drivers Installation

253

Page 254

254

7.5.4. Driver Details

255

7.5.5. System Diagnostics

256

[root@host]# rmmod kvm

257

[root@host]# rmmod cxgb4

257

[root@host]# modprobe cxgb4

258

Page 259

259

7.5.10. Xen Configurations

260

7.5.11. Xen VF Properties

261

Page 262

262

7.6. Network page

263

7.6.2. Chelsio card page

264

Card summary

264

Page 265

265

Page 266

266

Card statistics

267

Port summary

268

Port settings

269

Port statistics

270

Page 271

271

System network statistics

272

Page 273

273

Page 274

274

Page 275

275

Network troubleshooting

276

7.6.3.1. Hypervisor

277

Xen Bridge Configuration

277

Page 278

278

Page 279

279

Page 280

280

Page 281

281

Page 282

282

Page 283

283

7.6.4. iWARP

284

iWARP Settings

284

Page 285

285

Page 286

286

7.6.5. Wire Direct

287

Page 288

288

Page 289

289

7.7. Storage Page

290

Page 291

291

7.7.1.2. FCoE Port

292

FCoE Port Summary

292

FCoE Port Attributes

293

FCoE NPIV management

294

7.7.1.3. FCoE Remote Port

295

Page 296

296

7.7.1.4. FCoE Virtual Port

297

FCoE Virtual Port Summary

297

Page 298

298

Page 299

299

Initiator nodes

300

Page 301

301

Page 302

302

Discover targets

303

Page 304

304

Targets

305

Page 306

306

FO iSCSI Manage Ports

307

FO iSCSI Manage Instances

308

7.7.4. iSCSI Target (Linux)

309

Target Stack Globals

309

Page 310

310

Target properties

311

Session details

312

New Target Creation

313

7.7.5. LUNs

314

Add LUN

315

7.7.6. Portal Groups

316

Add Portal

317

7.7.7. ACLs

318

Add ACL

319

7.8. Hardware Features

320

T4 Filtering configuration

321

Page 322

322

Page 323

323

7.8.3. Boot

324

Page 325

325

T4/T5 Boot Configuration

326

Page 327

327

Page 328

328

Page 329

329

Page 330

330

Page 331

331

7.8.4. Bypass

332

Redirect Configuration

333

Page 334

334

Page 335

335

Egress Queue Map

336

Egress Packet Scheduler

336

Page 337

337

Page 338

338

XVIII. Unified Boot

339

C:\>cd CHELSIO

342

C:\CHELSIO>cfut4 –l

343

Page 344

344

Page 345

345

Page 346

346

3. Configuring PXE Server

347

4. PXE boot process

348

Page 349

349

Page 350

350

Page 351

351

Page 352

352

4.2. For uEFI PXE Boot

353

Page 354

354

Page 355

355

Page 356

356

Page 357

357

Page 358

358

Page 359

359

Page 360

360

Page 361

361

CHELSIO\cubt4.bin

362

Page 363

363

5. FCoE boot process

364

Page 365

365

Page 366

366

Page 367

367

Page 368

368

Page 369

369

Page 370

370

Page 371

371

Page 372

372

5.2. For uEFI FCoE Boot

373

Page 374

374

Page 375

375

Page 376

376

Page 377

377

Page 378

378

Page 379

379

Page 380

380

Page 381

381

Page 382

382

Page 383

383

Page 384

384

Page 386

386

6. iSCSI boot process

387

Page 388

388

Page 389

389

Page 390

390

Page 391

391

Page 392

392

Page 393

393

Page 394

394

Page 395

395

Page 396

396

Page 397

397

Page 398

398

Page 399

399

6.2. For uEFI iSCSI Boot

400

Page 401

401

Page 402

402

Page 403

403

Page 404

404

Page 405

405

Page 406

406

Page 407

407

Page 408

408

Page 409

409

Page 410

410

Page 411

411

Page 412

412

Page 413

413

Page 414

414

Page 415

415

Page 416

416

Page 417

417

Page 419

419

Page 420

420

Page 421

421

8. OS Installation

422

Page 423

423

Page 424

424

Page 425

425

Page 426

426

Page 427

427

Page 428

428

Page 429

429

Page 430

430

Page 431

431

8.2.1. Using CD/DVD ROM

432

Page 433

433

Page 434

434

Page 435

435

Page 436

436

8.3.1. Using CD/DVD ROM

437

Page 438

438

Page 439

439

Page 440

440

Page 441

441

Page 442

442

Page 443

443

Page 444

444

Page 445

445

Page 446

446

XIX. Appendix A

447

1. Troubleshooting

448

Page 449

449

Chapter XIX. Appendix

450





More products and manuals for Software Chelsio Communications

Models Document Type
Chelsio T4 User's Guide   Chelsio Communications Chelsio T4 User`s guide, 374 pages