Commit Graph

108 Commits

Author SHA1 Message Date
keyonghan
d36f246dcc Use bucket to check staging test instead of builder name (#88908) 2021-08-25 20:36:02 -07:00
keyonghan
884dfc260d Skip staging test update to cocoon in test runner (#88835) 2021-08-25 11:36:03 -07:00
keyonghan
b468be3030 Use default value for ResultData when uploading metrics from test runner (#88749) 2021-08-24 12:04:03 -07:00
keyonghan
208d312ff0 Upload devicelab test metrics from test runner (#88447) 2021-08-20 12:57:03 -07:00
yusufm
fe52e56614 Adding a timeout and retry to upload results step. (#87306)
* Adding a timeout and retry to upload results step.

* Adding tests for retries and timeout.

* Adding async to call

* Fixing sleep to trigger the timeout, and adding addition timeout test.

* Fixing minor typo.

* Fixing some minor flutter style issues.

Co-authored-by: yusufm <mohsinally@google.com>
2021-08-03 13:40:28 -07:00
Casey Hillers
79f377dabe [devicelab] Only upload results on master (#87125) 2021-07-27 12:49:05 -07:00
Darren Austin
8fcace1d6c Migrate devicelab tests and test runners to null safety. (#85999)
* Migrate devicelab tests and test runners to null safety.
2021-07-23 13:37:57 -07:00
keyonghan
3aeb794298 Extend test runner command to update test flaky status (#86513) 2021-07-19 09:46:03 -07:00
keyonghan
4d96a3fd50 Rerun devicelab task from test runner (#86394) 2021-07-14 15:23:10 -07:00
Dan Field
e36e62e9a6 Revert "Revert "Audit hashCode overrides outside of packages/flutter (#85370)" (#85451)" (#85567)
This reverts commit 2be0d57fa2.
2021-06-30 09:46:54 -07:00
Ren You
2be0d57fa2 Revert "Audit hashCode overrides outside of packages/flutter (#85370)" (#85451)
This reverts commit 9846fa5145.
2021-06-28 09:55:31 -07:00
Dan Field
9846fa5145 Audit hashCode overrides outside of packages/flutter (#85370) 2021-06-26 17:36:04 -07:00
Dan Field
5cc7b6c3ea Add option to stream logs to file for flutter logs and way to use it in devicelab runs (#84008) 2021-06-07 10:33:00 -07:00
Jenn Magder
94a41cde83 Mixed null safety in dev/devicelab (#84017) 2021-06-05 02:29:03 -07:00
Alexandre Ardhuin
34059eec2c enable lint prefer_interpolation_to_compose_strings (#83407) 2021-06-01 11:14:06 -07:00
Jenn Magder
1ff5665fdd Force LANG=en_US.UTF-8 in test runner (#82308) 2021-05-12 10:49:02 -07:00
yusufm
a083104830 Removing the agents task manifest.yaml file. (#81064)
All agents have been deleted and removing this entry with last few agent tasks that appear in the dashboard. And remove the test_manifest.dart as well.

Co-authored-by: yusufm <mohsinally@google.com>
2021-04-27 15:50:40 -07:00
Phil Quitslund
61c30c41b2 fix sort_directives violations (#80817) 2021-04-21 13:49:03 -07:00
Casey Hillers
c571804913 Revert "Reland [devicelab] Migrate Gallery to BuildTestTask (#78361)" (#79903)
This reverts commit 0c9781e3dd.
2021-04-06 16:28:54 -07:00
Casey Hillers
0c9781e3dd Reland [devicelab] Migrate Gallery to BuildTestTask (#78361) 2021-04-06 16:04:03 -07:00
Ian Hickson
f3c25fa07a Align more closely with package:test (#77118) (#78343) 2021-03-16 13:58:02 -07:00
Zachary Anderson
e7e1a04aa3 Revert "Align more closely with package:test (#77118)" (#78329)
This reverts commit 0cbe597540.
2021-03-16 09:26:34 -07:00
Ian Hickson
0cbe597540 Align more closely with package:test (#77118) 2021-03-15 16:28:02 -07:00
Michael Goderbauer
807bb29888 enable prefer_function_declarations_over_variables lint (#77398) 2021-03-05 18:29:04 -08:00
Casey Hillers
b0afe3464e Create BuildTestTask (#77307) 2021-03-04 18:49:03 -08:00
Casey Hillers
7ed797b053 Revert "[devicelab] Separate build and test from Flutter gallery tests (#76415)" (#77086)
This reverts commit 297c7b5cf2.
2021-03-02 12:17:18 -08:00
Casey Hillers
297c7b5cf2 [devicelab] Separate build and test from Flutter gallery tests (#76415) 2021-03-02 11:49:02 -08:00
Michael Goderbauer
fc99e7c0d7 Enable missing_whitespace_between_adjacent_strings (#77027) 2021-03-01 18:30:17 -08:00
godofredoc
f506aa93a3 Move a second batch of mac/ios tests to prod. (#76732)
Bug: https://github.com/flutter/flutter/issues/73392
2021-02-24 15:40:50 -08:00
Casey Hillers
5cac7c3b15 Add expectation test for upload metrics (#76642) 2021-02-23 16:11:03 -08:00
chunhtai
713fa8e360 Reland "add a benchmark test for stack size (#75039)" (#75434)
* Reland "add a benchmark test for stack size (#75039)"

This reverts commit de683de9d5.

* fix typo
2021-02-04 12:16:31 -08:00
Shi-Hao Hong
de683de9d5 Revert "add a benchmark test for stack size (#75039)" (#75383)
This reverts commit 9d9109aa6f.
2021-02-04 10:26:04 +08:00
chunhtai
9d9109aa6f add a benchmark test for stack size (#75039) 2021-02-03 15:16:03 -08:00
Jenn Magder
f4f33fd108 Dump logs on failing devicelab test to recipe artifact location (#74378) 2021-02-01 15:00:38 -08:00
Casey Hillers
849784e262 [devicelab] Add results path flag to test runner (#72765) 2020-12-22 16:45:38 -08:00
keyonghan
bb0e6ce9b0 Unflaky remaining linux tasks (#72563)
* remove flaky flag

* remove from manifest

* fix test
2020-12-17 17:23:35 -08:00
Casey Hillers
2565062df3 git branch flag (#71886) 2020-12-08 15:53:05 -08:00
Jim Graham
61460d255a preserve detailFiles entry in TaskResult JSON (#70668)
* preserve detailFiles entry in TaskResult JSON
2020-11-17 16:05:54 -08:00
Casey Hillers
a228a17c57 [devicelab] LUCI builder flag (#70702) 2020-11-17 11:28:03 -08:00
Casey Hillers
ce3ce20b14 [devicelab] Upload git branch (#68541) 2020-10-23 08:02:02 -07:00
Casey Hillers
1c35091a13 [devicelab] Cocoon client (#68333) 2020-10-19 13:12:04 -07:00
Casey Hillers
9e206a0c93 Refactor devicelab logic to use TaskResult instead of JSON (#67550) 2020-10-07 16:37:09 -07:00
Michael R Fairhurst
7f3c9b6bda Remove unused 'dart:async' imports. (#65568) 2020-09-16 14:14:06 -07:00
Tong Wu
aa0125387c [devicelab] This no-op change marks 3 tests to run on LUCI builders. (#61257) 2020-07-10 21:49:40 -07:00
Ming Lyu (CareF)
99f5eebc6b Add --device-id option for devicelab/bin/run.dart (#59276)
* Implement device selection for devicelab/run.dart

* Add test to --device-id option for devicelab/run

* Update dev/devicelab/bin/run.dart by jonahwilliam

* Rename deviceOperatingSystem enum mock -> fake

Co-authored-by: Jonah Williams <jonahwilliams@google.com>
2020-06-26 09:29:46 -04:00
Greg Spencer
ab68721a5d Add Android device build/OS/API Level information to logs. (#58747)
This adds some information about the chosen device to the output log so that we can tell what type of device/OS Level/API Level the test is running on when doing a postmortem on a failed test.
2020-06-05 14:02:07 -07:00
Jim Graham
3519bec6c4 Save results of A/B test runs in a JSON file for future processing (#56416) 2020-05-08 00:34:02 -07:00
Yegor
20803507fd print intermediate and raw A/B results when not silent (#54676)
* print intermediate A/B results when not silent
* print raw A/B results when in loud mode
* add tests; handle missing metrics more gracefully
* use less fancy section header on Windows
2020-04-16 14:36:42 -07:00
Jonah Williams
e21266294f Revert "Do not wait for connections after process has exited (#54497)" (#54618)
This reverts commit 283ec9e2a1.
2020-04-13 11:04:31 -07:00
Yegor
283ec9e2a1 Do not wait for connections after process has exited (#54497) 2020-04-10 16:54:10 -07:00