{{ message }}
Repository navigation
Commit ab5234b
chore: Add templates Apify E2E tests (#1109)
### Description
Add `crawlee` templates integration tests with `Apify` platform. (only
`Parsel` and `Beautifulsoup` templates)
Add workflow for manual triggering of integration tests (Will become
automatic once it is running for a while to prove stability.)
### Issues
- Closes: #1093
### Testing
Tested on forked repo:
- Example of no issue run:
https://github.com/Pijukatel/crawlee-python/actions/runs/13969844251
- Example of error in the template docker build (bad change in`uv`
related part of the dockerfile):
https://github.com/Pijukatel/crawlee-python/actions/runs/13970390933
- Example of error in the actor execution expectations (bad change in
`parsel` actor template):
https://github.com/Pijukatel/crawlee-python/actions/runs/13970267119
### Next steps
Add tests for `Playwright` based templates.
[Fix current problems with
`Playwright`](#1110)
template that has failing run in default settings.
Making the integration tests each run in separate job. Each test can
take long time and can be unstable due to the network issues. This
brings the necessity to have the possibility to re-trigger individual
tests and not the whole test suite.
Since Playwright based crawlers are slower, this will be introduced
together with their testing.
Example such run, where only one template test can be re-triggered:

---------
Co-authored-by: Vlada Dusek <v.dusek96@gmail.com>1 parent 77cbcc1 commit ab5234b
14 files changed
Lines changed: 333 additions & 18 deletions
File tree
- .github/workflows
- src/crawlee
- project_template
- hooks
- {{cookiecutter.project_name}}
- tests
- e2e
- project_template
- integration
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
72 | 72 | | |
73 | 73 | | |
74 | 74 | | |
75 | | - | |
76 | | - | |
| 75 | + | |
77 | 76 | | |
78 | | - | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
79 | 81 | | |
80 | | - | |
81 | | - | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
82 | 88 | | |
83 | 89 | | |
84 | 90 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
| 5 | + | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
35 | | - | |
36 | | - | |
| 35 | + | |
| 36 | + | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
92 | 92 | | |
93 | 93 | | |
94 | 94 | | |
| 95 | + | |
| 96 | + | |
95 | 97 | | |
96 | 98 | | |
97 | 99 | | |
| |||
119 | 121 | | |
120 | 122 | | |
121 | 123 | | |
122 | | - | |
| 124 | + | |
123 | 125 | | |
124 | 126 | | |
125 | 127 | | |
| |||
207 | 209 | | |
208 | 210 | | |
209 | 211 | | |
210 | | - | |
| 212 | + | |
211 | 213 | | |
212 | 214 | | |
213 | 215 | | |
| |||
229 | 231 | | |
230 | 232 | | |
231 | 233 | | |
| 234 | + | |
| 235 | + | |
232 | 236 | | |
233 | 237 | | |
234 | 238 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | | - | |
13 | | - | |
| 12 | + | |
| 13 | + | |
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
24 | | - | |
| 24 | + | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | 5 | | |
7 | 6 | | |
8 | 7 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
23 | | - | |
24 | | - | |
| 23 | + | |
25 | 24 | | |
26 | 25 | | |
27 | 26 | | |
| |||
Whitespace-only changes.

0 commit comments