WSL/SLF GitLab Repository

Skip to content

Tests fail: Results don't match the expected results

The tests in the pipeline now run without errors. However, most of the results don't match the expected results:

See Log here: https://gitlabext.wsl.ch/snow-models/alpine3d/-/jobs/4081/raw

...

1/2 Test #1: simple.smoke .....................***Failed  Error regular expression found in output. Regex=[error|differ|fail]157.64 sec
test 2
    Start 2: basics_simple.smoke

2: Test command: /builds/snow-models/alpine3d/build/tests/basics/run_basics.sh "../simple/output_ref/5_2_dischma.met.bz2"
2: Test timeout computed to be: 1500
2: CTEST_FULL_OUTPUT (line required by CTest to avoid output truncation)
2: 
2: *** Checking simulation 5_2_dischma.met
2: *** basic checks:
2: Comparing snow height (HS)                    [fail]   → 708 errors  µ_abs=1.88   µ_rel=0.065   @ 2014-10-29T12:00
2: Comparing surface temperature (TSS)           [fail]   → 414 errors  µ_abs=2.66   µ_rel=1.08    @ 2014-10-01T12:00
2: Comparing albedo (ALB)                        [fail]   →   1 error   µ_abs=0.051  µ_rel=0.0601  @ 2014-10-25T12:00
2: 
2: **** check the mass balance:
2: Comparing snow water equiv. (SWE)             [fail]   → 684 errors  µ_abs=1.06   µ_rel=0.0175  @ 2014-10-14T10:00
2: Comparing snow rate                           [fail]   →   1 error   µ_abs=3.29                 @ 2014-11-04T14:00
2: Comparing rain rate                           [OK]
2: Comparing snowpack runoff                     [fail]   →   1 error   µ_abs=0.772  µ_rel=0.632   @ 2014-10-14T10:00
2: 
2: **** check the energy balance components:
2: Comparing sensible heat                       [fail]   → 1074 errors  µ_abs=2.61   µ_rel=1.33    @ 2014-10-01T02:00
2: Comparing latent heat                         [fail]   → 1075 errors  µ_abs=1.62   µ_rel=7.78    @ 2014-10-01T02:00
2: Comparing OLWR                                [fail]   → 657 errors  µ_abs=10.6   µ_rel=0.038   @ 2014-10-01T02:00
2: Comparing ILWR                                [fail]   → 699 errors  µ_abs=10.4   µ_rel=0.0406  @ 2014-10-02T08:00
2: Comparing RSWR                                [fail]   → 138 errors  µ_abs=3.79   µ_rel=0.0689  @ 2014-10-01T10:00
2: Comparing ISWR                                [fail]   →  73 errors  µ_abs=13.4   µ_rel=0.0858  @ 2014-10-01T10:00
2: Comparing ground flux                         [OK]
2: Comparing rain heat flux                      [fail]   →  45 errors  µ_abs=0.0342  µ_rel=2.22    @ 2014-10-01T02:00
2: Comparing surface input heat flux             [fail]   → 1061 errors  µ_abs=13.4   µ_rel=0.772   @ 2014-10-01T02:00
2: 
2: **** check the internal energy state:
2: Comparing internal energy change              [fail]   → 821 errors  µ_abs=7.23   µ_rel=0.623   @ 2014-10-14T02:00
2: Comparing phase change heat flux              [fail]   → 158 errors  µ_abs=13.1   µ_rel=2.41    @ 2014-10-14T08:00
2: Comparing liquid water content (LWC)          [OK]
2/2 Test #2: basics_simple.smoke ..............***Failed  Error regular expression found in output. Regex=[error|differ|fail]  0.88 sec

0% tests passed, 2 tests failed out of 2
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information