FilesExpand file tree

 main

/

crawlerConfig.json

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

25 lines (25 loc) · 544 Bytes

 main

/

crawlerConfig.json

Copy path

Top

File metadata and controls

• Code
• Blame

25 lines (25 loc) · 544 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

{

"index_name": "ProgramLearnNotes",

"start_urls": ["https://muyacode.github.io/ProgramLearnNotes/"],

"rateLimit": 8,

"maxDepth": 10,

"selectors": {

"lvl0": {

"selector": "",

"defaultValue": "Documentation"

},

"lvl1": ".content h1",

"lvl2": ".content h2",

"lvl3": ".content h3",

"lvl4": ".content h4",

"lvl5": ".content h5",

"content": ".content p, .content li"

},

"selectors_exclude": [

"aside",

".page-footer",

".next-and-prev-link",

".table-of-contents"

],

"js_render": true

}