File overview:
es5_tests.txt: This file contains a list of ES5 test cases. If useful cases are found missing, you can add them as needed.
es2015_tests.txt: This file contains a full list of use cases of ES2015 except those filtered out with'es6id'. If useful cases are found missing, you can add them as needed.
es2021_tests.txt: This file contains a full list of use cases of ES2021 except those filtered out with'es6id'. If useful cases are found missing, you can add them as needed.
intl_tests.txt： This file contains a list of internationalization test cases. If you find useful cases missing, you can add them as needed.
skip_tests.json: This file contains a list of use cases that do not meet the requirements. If useful cases are found missing, you can add them according to the specified format.
intl_skip_tests.json: This file contains a list of non-compliant internationalization use cases. If useful cases are found to be missing, they can be added in the specified format.
1. Compile ts2abc and ark_js_vm project
./build.sh --product-name hispark_taurus_standard --build-target ark_js_vm --build-target ark_ts2abc_build
2 Run test cases
2.1 Options
usage: run_test262.py [-h] [--dir DIR] [--file FILE] [--mode [{1,2,3}]]
[--es51] [--es2015 [{all,only}]] [--esnext]
[--engine FILE] [--babel] [--timeout TIMEOUT]
[--threads THREADS] [--hostArgs HOSTARGS]
[--ark-aot]
[--ark-aot-tool ARK_AOT_TOOL]
[--ark-tool ARK_TOOL]
[--ark-frontend-tool ARK_FRONTEND_TOOL]
[--libs-dir LIBS_DIR]
[--ark-frontend [{ts2panda,es2panda}]]
optional arguments:
-h, --help Show this help message and exit
--dir DIR Directory to test
--file FILE File to test
--mode [{1,2,3}] selection information as: 1: only default 2:
only strict mode 3: both default and strict mode
--es51 Run test262 ES5.1 version
--es2015 [{all,only}]
Run test262 - ES2015. all: Contains all use cases for
ES5 and ES2015, only: Only include use cases for
ES2015
--esnext Run test262 - ES.next.
--engine FILE Other engine binarys to run tests with
(as:d8,hermes,jsc,qjs...)
--babel Whether to use Babel conversion
--timeout TIMEOUT Set a custom test timeout in milliseconds !!!
--threads THREADS Run this many tests in parallel. Note that the browser
runners don't work great with t > 1.
--hostArgs HOSTARGS command-line arguments to pass to eshost host
--ark-aot Run test262 with aot
--ark-aot-tool ARK_AOT_TOOL
ark's aot tool
--ark-tool ARK_TOOL ark's binary tool
--ark-frontend-tool ARK_FRONTEND_TOOL
ark frontend conversion tool
--libs-dir LIBS_DIR The path collection of dependent so, divided by':'
--ark-frontend [{ts2panda,es2panda}]
Choose one of them
2.2 Run all the test cases
python3 test262/run_test262.py
2.3 Run es51 related test cases
python3 test262/run_test262.py --es51
After the execution finished, a directory named test_es51 is created under directory test262/data , which is used to store all es51 cases.
2.4 Run es2015 related test cases
2.4.1 only include use cases for ES2015
python3 test262/run_test262.py --es2015 only
2.4.2 Contains all use cases for ES5 and ES2015
python3 test262/run_test262.py --es2015 all
2.5 Run single test case
python3 test262/run_test262.py --file test262/data/test_es5/language/statements/break/12.8-1.js
2.6 Run all the test cases under specified directory
python3 test262/run_test262.py --dir test262/data/test_es5/language/statements
2.7 Run single test case with other engines. Take d8 as an example
python3 test262/run_test262.py --engine="/home/share/v8-code/v8/out.gn/x64.release/d8" --file test262/data/test_es5/language/statements/break/12.8-1.js
2.8 Run single test case with babel conversion
python3 test262/run_test262.py --babel --file test262/data/test_es5/language/statements/break/12.8-1.js
2.9 Get test result
take the following code as an example:
zgy@lfgphicprd23154:/home/share/OpenHarmony2.0_20210604/ark/ts2abc$ python3 -B test262/run_test262.py --file test262/data/test_es51/language/statements/break/12.8-1.js
Wait a moment..........
07-30 16:56:03.857383 D:>>> command: npm install | dir: /home/share/OpenHarmony2.0_20210604/out/ohos-arm-release/clang_x64/arkcompiler/ets_frontend/build/src/..
npm WARN ts2panda@1.0.0 No description
npm WARN ts2panda@1.0.0 No repository field.
npm WARN ts2panda@1.0.0 No license field.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY: fsevents@2.3.2 (node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for fsevents@2.3.2: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
up to date in 2.225s
28 packages are looking for funding
run `npm fund` for details
07-30 16:56:06.746184 D:>>> command: npm install | dir: test262/eshost
up to date in 1.446s
1 package is looking for funding
run `npm fund` for details
07-30 16:56:08.767037 D:>>> command: npm install | dir: test262/harness
up to date in 2.412s
07-30 16:56:11.836409 D:>>> command: git checkout -- . | dir: test262/data
07-30 16:56:12.012115 D:>>> command: git checkout 9ca13b12728b7e0089c7eb03fa2bd17f8abe297f | dir: test262/data
HEAD is now at 9ca13b1272 Fix typo in BigIntArray property descriptor test
07-30 16:56:12.275768 D:>>> command: git checkout -- . | dir: test262/eshost
07-30 16:56:12.280134 D:>>> command: git apply ../eshost.patch | dir: test262/eshost
07-30 16:56:12.283263 D:>>> command: git checkout -- . | dir: test262/harness
07-30 16:56:12.288134 D:>>> command: git apply ../harness.patch | dir: test262/harness
Test command:
node
test262/harness/bin/run.js
--hostType=panda
--hostPath=python3
--hostArgs='-B test262/run_sunspider.py --ark-tool=/home/share/OpenHarmony2.0_20210604/out/ohos-arm-release/clang_x64/arkcompiler/ets_runtime/ark_js_vm --ark-frontend-tool=/home/share/OpenHarmony2.0_20210604/out/ohos-arm-release/clang_x64/arkcompiler/ets_frontend/build/src/index.js --libs-dir=/home/share/OpenHarmony2.0_20210604/out/ohos-arm-release/clang_x64/arkcompiler/ets_runtime:/home/share/OpenHarmony2.0_20210604/out/ohos-arm-release/clang_x64/global/i18n_standard:/home/share/OpenHarmony2.0_20210604/prebuilts/clang/ohos/linux-x86_64/llvm/lib/ --ark-frontend=ts2panda '
--threads=15
--mode=only strict mode
--timeout=60000
--tempDir=out/test262
--test262Dir=test262/data
--saveCompiledTests
test262/data/test_es51/language/statements/break/12.8-1.js
FAIL test262/data/test_es51/language/statements/break/12.8-1.js (strict mode)
Ran 1 tests
0 passed
1 failed
used time is: 0:00:13.303865
-
defaultindicatesnon-strictmode;strict modeindicates the strict mode. -
After the execution finished, the following files are generated under directory
out/test262/(you can specified it intest262/config.py):
-rw-rw-r-- 1 zgy zgy 7583 Nov 21 18:18 12.8-1-default.abc
-rw-rw-r-- 1 zgy zgy 415 Nov 21 18:18 12.8-1.js.panda.default.err
-rw-rw-r-- 1 zgy zgy 4389 Nov 21 18:18 12.8-1.js.panda.default.fail
-rw-rw-r-- 1 zgy zgy 415 Nov 21 18:18 12.8-1.js.panda.strict.err
-rw-rw-r-- 1 zgy zgy 4403 Nov 21 18:18 12.8-1.js.panda.strict.fail
-rw-rw-r-- 1 zgy zgy 7601 Nov 21 18:18 12.8-1-strict.abc
.abc indicates the generated binary abc file.
.err indicates that an error occurred during the test.
.fail/.pass is the file saved after js file has been preprocessed.
The result.txt file is generated under directory out/test262 to save statistics after the test finished.