Changes between Version 6 and Version 7 of NuWa_Slave

Timestamp:

09/02/10 12:15:35 (15 years ago)

Author:

blyth (IP: 140.112.102.77)

Comment:

--

NuWa_Slave

@@ -274 +274 @@
 
 
-
- 
-
-
-
-
-
+== Causes of test failure ==
+
+Non-''Run'' tests can fail by 
+  * an assertion/exception in the test being triggered 
+ 
+''Run-style'' tests have many additional ways to fail...  
+  * stdout + stderr from command matches a pattern with integer code > 0
+  * time taken by the command exceeds the limit
+  * command returns with non-zero exit code 
+  * memory(maxrss) taken by the command exceeds limit 
+  * for '''{{{reference=True}}}''' tests, the output does not match the reference
+  * for '''{{{histref=path/to/hists.root}}}''' tests, any of created histograms do not match the reference '''{{{path/to/histref_hists.root}}}'''
+ 
+=== Updating reference output/histograms ===
+ 
+To update reference outputs or histograms :
+  * simply delete the old one, a new reference will be created at next run, subsequent runs will compare against the new reference
+
+Find '''test_name.ref''' and '''histref_*.root''' by :
+{{{
+[blyth@cms01 ~]$ cd $DYB/NuWa-trunk/dybgaudi
+[blyth@cms01 dybgaudi]$ find . -name '*.ref'
+
+./Simulation/GenTools/test_diffuser.ref
+./Simulation/GenTools/test_gun.ref
+./Simulation/DetSim/test_historian.ref
+./Simulation/DetSim/test_basic_physics.ref
+./DataModel/Conventions/test_Conventions.ref
+./Production/MDC10b/test_dby0.ref
+./RootIO/RootIOTest/test_dybo.ref
+./RawData/RawDataTest/share/rawpython.log.ref
+./DybAlg/test_dmp.ref
+./Tutorial/Quickstart/test_printrawdata_output.ref
+./Database/DbiTest/scripts/TestDbiIhep.log.ref
+./Database/DbiValidate/tests/test_Conventions.ref
+
+[blyth@cms01 dybgaudi]$ find . -name 'histref_*.root'
+./Production/MDC10b/histref_dby1test.root
+./Tutorial/Quickstart/histref_rawDataResult.root
+[blyth@cms01 dybgaudi]$
+
+}}}
+ 
+
+
+
+ 
+
+
+
+
+