Task #10517 (closed)
Opened 11 years ago
Closed 7 years ago
Add BF-CLI tests
| Reported by: | jamoore | Owned by: | |
|---|---|---|---|
| Priority: | major | Milestone: | Unscheduled |
| Component: | Bio-Formats | Version: | 4.4.8 |
| Keywords: | tools, testing | Cc: | khgillen, sbesson, bf@… |
| Resources: | n.a. | Referenced By: | n.a. |
| References: | n.a. | Remaining Time: | n.a. |
| Sprint: | n.a. |
Description (last modified by jamoore)
An automated test should be added for the command-line scripts. This will likely need to be done in concert with new CI infrastructure so that both the shell and the batch scripts are regularly tested.
See:
Change History (12)
comment:1 Changed 11 years ago by mlinkert
- Owner changed from mlinkert-x to mlinkert
comment:2 Changed 11 years ago by mlinkert
- Milestone changed from Unscheduled to Testing
- Sprint set to Testing and Docs (1)
- Version set to 4.4.8
comment:3 Changed 11 years ago by jamoore
- Milestone changed from Testing and Docs to Testing2
- Sprint Testing and Docs (1) deleted
comment:4 Changed 11 years ago by jamoore
- Description modified (diff)
comment:5 Changed 10 years ago by mlinkert
- Milestone changed from Testing2 to 5.0.3
comment:6 Changed 10 years ago by mlinkert
- Milestone changed from 5.0.3 to 5.1.0
comment:7 Changed 9 years ago by mlinkert
- Milestone changed from 5.1.0 to 5.1.1
comment:8 Changed 9 years ago by mlinkert
- Milestone changed from 5.1.1 to 5.2.0-m1
comment:9 Changed 9 years ago by jamoore
- Milestone changed from 5.2.0 to B-F-5.2.0
comment:10 Changed 8 years ago by mlinkert
- Keywords tools testing added
- Owner mlinkert deleted
No active work going on here, so if anyone wants to get more familiar with showinf/bfconvert options this would be a good one to pick up.
Initial thinking was to pick a few datasets from test_images_good (1 big image; 1 RGB; 1 with multiple Z, C, and T; 1 with differently-sized series) and a handful of combinations of options for each of showinf and bfconvert. For showinf, run each combination of commands against each file and just make sure that the exit status is 0 for all. For bfconvert, run each set of commands against each file by hand once, verify that the output files are correct and generate a config file in the data_repo_config repository; then the actual test runs the same commands, followed by test-automated against the known-good config file.
This could almost certainly be done all in python if that makes things easier - I wouldn't expect new Java code to be necessary for basic tests. Fully comprehensive unit tests would require https://trac.openmicroscopy.org/ome/ticket/8260, so that's not in the scope of this ticket as far as I'm concerned.
comment:11 Changed 8 years ago by sbesson
- Milestone changed from B-F-5.2.0 to Unscheduled
ca do not see us getting into full command-line tools testing infrastructure in the scope of 5.2.0. As an aside which I have not investigated, is there some value in having part of the testing at the Java level using TestNG?
comment:12 Changed 7 years ago by sbesson
- Resolution set to fixed
- Status changed from new to closed
See https://github.com/openmicroscopy/bioformats/pull/2717 for a proposal using TestNG
Splitting due to milestone decoupling.