Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-576

Testsuite tasks (tracking)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • None
    • None
    • Test Suite
    • None

    Description

      Post-7.1.1 jiras: AS7-4067

      Arquillian tasks affecting the testsuite: https://docspace.corp.redhat.com/docs/DOC-71831

      Maven wishes for summer:

      Attachments

        Issue Links

          incorporates

          Feature Request - Feature requests from customers and/or users AS7-4179 Ability to easily change AS7 log levels when running the tests

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Feature Request - Feature requests from customers and/or users AS7-4140 Change distribution of -Dmcast through testsuite

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. AS7-3786 Some non-Arquillian TestCases are run against hard-coded 127.0.0.1

          • Critical - To be worked on immediately following BLOCKER issues.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. AS7-2847 TS: Clustering tests cannot be run for single test with -Dtest=X

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. AS7-2909 AS7 testsuite - maven.test.failure.ignore vs. surefire.test.failure.ignore

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Task - Represents a small unit of work that is not end-user facing. WFLY-418 TS: Move resources to source packages.

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Closed

          Quality Risk - A potential bug. AS7-3696 TS: Replace hardcoded URLs and IP adresses with @ArquillianResource-s. [TRACKING]

          • Critical - To be worked on immediately following BLOCKER issues.
          • Resolved

          Tracker - Issue tracking a bug fix or improvement in another component AS7-4080 @Ignored tests (tracking)

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) AS7-3987 Replace jboss.dist with jboss.home for testsuite and other usage

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) WFLY-228 TS: Migrate from Surefire to Failsafe maven plugin.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) WFLY-1057 TS: "Big app" using many features, to serve for :restart test

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Closed
          is blocked by

          Feature Request - Feature requests from customers and/or users AS7-2203 Add Arquillian Container support for AS 7 domain controller

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Resolved

          Feature Request - Feature requests from customers and/or users AS7-3727 Arq: Make mgmt address and port available in the @Deployment method.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Feature Request - Feature requests from customers and/or users AS7-2616 Allow AS7 Arquillian container to pass credentials/securely authenticate

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Feature Request - Feature requests from customers and/or users ARQ-645 @ArquillianResource @OperatesOnDeployment("foo") URL; for multiple containers

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users WFLY-1182 @RestoreASConfigAfterTest to make a snapshot before test and reload it after.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users WFLY-1198 Arq: @CleanContainerDataDirsAfterTest - Delete data/ and /tmp after test is run.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users WFLY-277 TS: Integrate JUnitDiff

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Closed

          Feature Request - Feature requests from customers and/or users ARQ-647 Implement a convenient way to pass system properties to managed container's JVM.

          • Critical - To be worked on immediately following BLOCKER issues.
          • Open

          Feature Request - Feature requests from customers and/or users ARQ-648 Implement @ArquillianResource Map<URL> for multi-container configuration.

          • Critical - To be worked on immediately following BLOCKER issues.
          • Open

          Feature Request - Feature requests from customers and/or users ARQ-689 Implement @BeforeDeploy (possibly as an extension)

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open

          Feature Request - Feature requests from customers and/or users ARQ-690 Verify ability to run under a security manager (evt. create a policy file)

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open

          Feature Request - Feature requests from customers and/or users ARQ-710 Separated per-test and per-container log files.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open

          Feature Request - Feature requests from customers and/or users ARQ-746 Run tests on different containers, stopping and starting them between tests (with automatic grouping).

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open

          Bug - A problem that impairs or prevents the functions of the product. AS7-4070 CLONE - Arquillian should wait until a port is free after AS JVM process ends to prevent "port in use".

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. AS7-3111 @ArquillianResource InitialContext injection does not work in @RunAsClient annotated tests (remote JNDI)

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. ARQ-696 Last test's standard output is not saved - probably missing flush() ?

          • Minor - To be worked after urgent, high, and medium priorities are resolved. This term is chosen when the severity of the issue is low, or the complexity or effort to correct it may be higher, relatively speaking. For low priority issues, known workarounds exist or are not needed due to the trivial effort needed to address the issue.
          • Open

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) ARQ-697 Exception "Could not deploy to container" should report the real exception why the managed server is failing

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) AS7-3718 Copy cause exception message to DeploymentException: "Could not deploy to container".

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) ARQ-742 Print the name of the container in the "Could not deploy to container" exception.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open
          is related to

          Sub-task - The sub-task of the issue AS7-581 Identify all public APIs

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. WFLY-698 Intermitent testsuite failures (tracking)

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Closed

          Task - Represents a small unit of work that is not end-user facing. AS7-650 Create POM and Assembly for AS7 Public APIs

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue WFLY-765 Allow Arquillian tests to monitor server and deployment status explicitly

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Feature Request - Feature requests from customers and/or users ARQ-797 Should support measuring deployment, test, undeployment times separately

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Feature Request - Feature requests from customers and/or users ARQ-638 Option to "clean" the container before running tests

          • Optional - The request should be considered desirable but is not an immediate necessity.
          • Pull Request Sent

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) ARQ-803 Mark the skipped tests somehow in JUnit reports when the container failed to boot.

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Open
          1.
          		 Tests must fail the build by default. Sub-task Closed Major Ondrej Zizka (Inactive)  
          2.
          		 TS: Compare sets of tests run in both versions for respective groups Sub-task Closed Major Ondrej Zizka (Inactive)  
          3.
          		 TS: Check regressions Sub-task Closed Major Ondrej Zizka (Inactive)  
          4.
          		 TS: Implement test reporting. Sub-task Closed Major Ondrej Zizka (Inactive)  
          5.
          		 TS: Check scripts options. Sub-task Closed Major Ondrej Zizka (Inactive)  
          6.
          		 TS: Check -Dtest Sub-task Closed Major Ondrej Zizka (Inactive)  
          7.
          		 TS: Some tests are still in org.jboss.as.testsuite.integration package Sub-task Closed Major Ondrej Zizka (Inactive)  
          8.
          		 Maven plugin to process properties Sub-task Closed Major Ondrej Zizka (Inactive)  
          9.
          		 TS: Coverage reports Sub-task Closed Major Ondrej Zizka (Inactive)  
          10.
          		 build.sh clean install -DallTests doesn't work after scripts were split Sub-task Closed Major Ondrej Zizka (Inactive)  
          11.
          		 TS: #!/bin/sh prevents using bash construct Sub-task Closed Major Ondrej Zizka (Inactive)  
          12.
          		 TS: Prepare for merging into master. Sub-task Closed Major Ondrej Zizka (Inactive)  
          13.
          		 TS: Check clustering and compat and spec tests Sub-task Closed Major Ondrej Zizka (Inactive)  
          14.
          		 TS: Discuss package names - org.jboss.as.testsuite.integration.xyz vs. org.jboss.as.test.xyz Sub-task Closed Optional Ondrej Zizka (Inactive)  
          15.
          		 TS: Discuss resources location - next to .java files? Sub-task Closed Minor Ondrej Zizka (Inactive)  
          16.
          		 TS: Consolidate documentation of the testsuite. Sub-task Closed Major Ondrej Zizka (Inactive)  
          17.
          		 TS: Tests grouping Sub-task Closed Major Honza Brázdil  
          18.
          		 TS: Add a module for shared util classes. Sub-task Closed Major Ondrej Zizka (Inactive)  
          19.
          		 TS: Review smoke tests Sub-task Closed Major Ondrej Zizka (Inactive)  
          20.
          		 TS: Pick the most acceptable test packages organization Sub-task Closed Major Ondrej Zizka (Inactive)  
          21.
          		 TS: Put all management tests into one dir (org.jboss.as.test.integration.mgmt) Sub-task Closed Major Ondrej Zizka (Inactive)  
          22.
          		 Alternative JDKs for building and running - OpenJDK 6, 7, Sun JDK 7, IcedTea Sub-task Closed Major Ondrej Zizka (Inactive)  
          23.
          		 TS: Get new harness to master. Sub-task Closed Critical Ondrej Zizka (Inactive)  
          24.
          		 TS: Check tests workdirs Sub-task Closed Major Ondrej Zizka (Inactive)  
          25.
          		 TS: Logging issues (tracking) Sub-task Closed Major Unassigned  
          26.
          		 TS: Move Arquillian configs from src/test/resources/X to some special dir. Sub-task Closed Major Ondrej Zizka (Inactive)  
          27.
          		 TS: Fix -Ddebug (-Djpda) Sub-task Closed Major Ondrej Zizka (Inactive)  
          28.
          		 TS: IPv6 testing issues (tracking) Sub-task Closed Critical Ondrej Zizka (Inactive)  
          29.
          		 TS: Unify activation properties' names (e.g. -DstressTests instead of -Dstress-test) Sub-task Closed Major Ondrej Zizka (Inactive)  
          30.
          		 TS: On -Dtest=..., activate appropriate modules automatically (using package prefix) Sub-task Closed Major Ondrej Zizka (Inactive)  
          31.
          		 TS: Define testsuite acceptance test (a testsuite for the testsuite) Sub-task Closed Major Ondrej Zizka (Inactive)  
          32.
          		 TS: `mvn install` and `build.sh` must run smoke tests by default. Sub-task Closed Major Ondrej Zizka (Inactive)  
          33.
          		 TS: Move smoke and integration tests before the domain stuff. Sub-task Closed Major Ondrej Zizka (Inactive)  
          34.
          		 TS: Generate server config for Arq instances (standalone-*.xml) using XSLT instead of keeping them in resources. Sub-task Closed Major Ondrej Zizka (Inactive)  
          35.
          		 TS: Test output is not stored in ...-output.txt Sub-task Closed Major Unassigned  
          36.
          		 TS: Print help banner on `mvn install` without params. Sub-task Closed Major Ondrej Zizka (Inactive)  
          37.
          		 Propagate property node0 to system properties Sub-task Closed Major Ondrej Zizka (Inactive)  
          38.
          		 TS: Add properties "jbossas.ts.integ.dir", "jbossas.ts.dir", "jbossas.project.dir" and use them in test. Sub-task Closed Major Ondrej Zizka (Inactive)  
          39.
          		 TS: Move *-arquillian.xml from testsuite.integration/src/test/resources/** to some better place. Sub-task Closed Major Ondrej Zizka (Inactive)  
          40.
          		 TS: Clustering tests - figure out how they will be run Sub-task Closed Major Radoslav Husar  
          41.
          		 TS: Hitting max file limit with reporting (`mvn site`) Sub-task Closed Major Ondrej Zizka (Inactive)  
          42.
          		 TS: (Re-)Create test group for web profile. Sub-task Closed Major Unassigned  
          43.
          		 TS: Update windows scripts (build.bat and integration-tests.bat) Sub-task Closed Minor Madhumita Sadhukhan (Inactive)  
          44.
          		 TS: Check tests for hard-coded strings like URLs etc. - candidates for parametrization. Sub-task Closed Major Ondrej Zizka (Inactive)  
          45.
          		 TS: Implement self-test. Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 4 days
          Remaining Estimate - 4 days
          46.
          		 TS: Option to run under security manager. Sub-task Closed Major Peter Skopek  
          47.
          		 TS: Configurable timeouts Sub-task Closed Major Ondrej Zizka (Inactive)  
          48.
          		 TS: Option to fail if AS is running (~ a port is open) Sub-task Closed Major Ondrej Zizka (Inactive)  
          49.
          		 TS: Multiple Surefire executions - FAILURE in one supresses successive. Sub-task Closed Major Unassigned  
          50.
          		 TS: Database switch (in datasources) Sub-task Closed Major Ondrej Zizka (Inactive)  
          51.
          		 TS: -Djboss.dist=... has no effect, /build/target/jboss-as* is always used Sub-task Closed Critical Ondrej Zizka (Inactive)

          100%
          Original Estimate - 1 week, 2 days Original Estimate - 1 week, 2 days
          Time Spent - 1 week, 3 days
          52.
          		 TS: Way to build with a clean local repo. Sub-task Closed Major Ondrej Zizka (Inactive)  
          53.
          		 TS: Find a way to retain same value of property with ${basedir} in submodules. Sub-task Closed Major Ondrej Zizka (Inactive)  
          54.
          		 TS: Check endorsed jboss-annotations-api. Sub-task Closed Major Ondrej Zizka (Inactive)  
          55.
          		 TS: Make commons-lang3, commons-io and commons-codec available in tests. Sub-task Closed Major Ondrej Zizka (Inactive)  
          56.
          		 TS: Check how JDBC drivers are copied Sub-task Closed Major Honza Brázdil  
          57.
          		 TS: Make container JVM --enable-assertions configurable. Sub-task Closed Optional Ondrej Zizka (Inactive)

          0%
          Original Estimate - 2 hours
          Remaining Estimate - 2 hours
          58.
          		 TS: Pass the path to docs/examples to the tests. Sub-task Closed Major Unassigned

          0%
          Original Estimate - 2 hours
          Remaining Estimate - 2 hours
          59.
          		 TS: Fix XSLT transformations (namespaces problem) Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 2 days
          Remaining Estimate - 2 days
          60.
          		 TS: parametrize surefire test.redirectTestOutputToFile property Sub-task Closed Major Ondrej Zizka (Inactive)  
          61.
          		 TS: Pass node0, node1 to <ant ...> since inheritAll="true" doesn't work. Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 2 hours
          Remaining Estimate - 2 hours
          62.
          		 TS: Add $managementAddress and $managementPort to all arquillian.xml's. Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 3 hours
          Remaining Estimate - 3 hours
          63.
          		 TS: Script to check missed tests. Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 1 hour
          Remaining Estimate - 1 hour
          64.
          		 TS: Some tests missing from <includes> and are not run. Sub-task Closed Minor Ondrej Zizka (Inactive)

          0%
          Original Estimate - 3 hours
          Remaining Estimate - 3 hours
          65.
          		 TS: Allow debugging client with -DdebugClient (only AS is possible now) Sub-task Closed Major Unassigned

          0%
          Original Estimate - 4 hours
          Remaining Estimate - 4 hours
          66.
          		 TS: -Dtest=*<something>* only matches one test per module. Sub-task Closed Major Aslak Knutsen  
          67.
          		 TS: Implement replacing of ...=localhost in .properties resources Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 2 hours
          Remaining Estimate - 2 hours
          68.
          		 TS: Allow XSLT to fit any namespace versions. Sub-task Closed Major Unassigned

          12%
          Original Estimate - 2 days
          Time Spent - 2 hours Remaining Estimate - 1 day, 6 hours
          69.
          		 Implement fallback mechanism for AS7 properties in pom.xml Sub-task Closed Major Pavel Janousek  
          70.
          		 TS: Dynamic way to get ports of various services. Sub-task Closed Major Unassigned

          0%
          Original Estimate - 1 day
          Remaining Estimate - 1 day
          71.
          		 TS: API changes report - Animal sniffer maven plugin Sub-task Closed Major Ondrej Zizka (Inactive)

          0%
          Original Estimate - 3 days
          Remaining Estimate - 3 days
          72.
          		 TS: Make Surefire test ordering configurable. Sub-task Closed Major Unassigned

          0%
          Original Estimate - 4 hours
          Remaining Estimate - 4 hours

          Activity

            People

              ozizka_jira Ondrej Zizka (Inactive)
              ozizka_jira Ondrej Zizka (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 4 weeks, 1 day, 7 hours Original Estimate - 4 weeks, 1 day, 7 hours
                  4w 1d 7h
                  Remaining:
                  Time Spent - 1 week, 3 days, 2 hours Remaining Estimate - 2 weeks, 4 days, 5 hours
                  2w 4d 5h
                  Logged:
                  Time Spent - 1 week, 3 days, 2 hours Remaining Estimate - 2 weeks, 4 days, 5 hours
                  1w 3d 2h