mozilla-central/taskcluster/scripts/tests
Name Description Size
compute-macrobenchmark-results.py Reads the JSON file and returns the benchmark results as a dictionary. 4321
copy-artifacts-from-ftl.py This script is designed to automate the process of fetching artifacts (either baseline profile or crash logs) from Google Cloud Storage (GCS) for devices in Firebase TestLab. It is intended to be run as part of a Taskcluster job following a scheduled test task, or as part of a Taskcluster that runs baseline profile generation on Firebase TestLab. The script requires the presence of a `matrix_ids.json` artifact in the results directory and the availability of the `gsutil` command in the environment. The script performs the following operations: - Loads the `matrix_ids.json` artifact to identify the GCS paths for the artifacts. - In the case of crash logs, identifies failed devices based on the outcomes specified in the `matrix_ids.json` artifact. - Fetches the specified artifact type (baseline profiles or crash logs) from the specified GCS paths. - Copies the fetched artifacts to the current worker artifact results directory. The script is configured to log its operations and errors, providing visibility into its execution process. It uses the `gsutil` command-line tool to interact with GCS, ensuring compatibility with the GCS environment. Usage: python3 copy-artifacts-from-ftl.py <artifact_type> artifact_type: "baseline_profile" or "crash_log" Requirements: - The `matrix_ids.json` artifact must be present in the results directory. - The `gsutil` command must be available in the environment. - The script should be run after a scheduled test task in a Taskcluster job or as part of a scheduled baseline profile task in a Taskcluster job Output: - Artifacts are copied to the current worker artifact results directory. 12618
parse-junit-results.py Script to parse and print UI test JUnit results from a FullJUnitReport.xml file. This script processes JUnit test results generated by Flank and Firebase Test Lab. It reads test results from a specified directory containing a full JUnit report, parses the results to identify test failures and flaky tests, and prints a formatted table summarizing these results to the console. - Parses JUnit XML test result files, including custom 'flaky' attributes. - Identifies and displays unique test failures and flaky tests. - Prints the results in a readable table format using BeautifulTable. - Provides detailed failure messages and test case information. - Designed for use in Taskcluster following a Firebase Test Lab test execution. Flank: https://flank.github.io/flank/ Usage: python3 parse-junit-results.py --results <path_to_results_directory> 6222
test-lab.py Configure logging for the script. 7497