--allure-link-pattern option don't filter any test. #433

eskignax · 2019-10-01T08:09:36Z

I'm submitting a ...

[ X ] bug report
feature request
support request => Please do not submit support request here, see note at the top of this template.

What is the current behavior?

--allure-link-pattern option don't filter any test, and run the full suite.

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem

import allure

@allure.testcase('https://redmine.xxx.com/issues/25','25')
def test_with_allure_link():
    pass

def test_without_allure_link():
    pass

(venv) bash-5.0$ python3 -m pytest --allure-link-pattern='testcase:https://redmine.xxx.com/issues/25'
======================================================================================= test session starts ========================================================================================
platform linux -- Python 3.7.4, pytest-5.0.1, py-1.8.0, pluggy-0.12.0
rootdir: /home/xxx/PycharmProjects/sandbox/bugs
plugins: allure-pytest-2.7.0
collected 2 items                                                                                                                                                                                  

test_allure_link.py ..                                                                                                                                                                       [100%]

===================================================================================== 2 passed in 0.02 seconds =====================================================================================

What is the expected behavior?

--allure-link-pattern should only run the test with the matching link decorator.

Please tell us about your environment:

Allure version: 2.8.1
Test framework: pytest@5.1.2 also tested on 5.1.0
Allure adaptor: allure-pytest@2.8.4 also tested on 2.7.0

Other information

python3 -m pytest --allure-link-pattern='testcase:https://redmine.xxx.com/issues/25'
============================= test session starts ==============================
platform linux -- Python 3.7.4, pytest-5.1.2, py-1.8.0, pluggy-0.12.0
rootdir: /server/xxx, inifile: pytest.ini, testpaths: features/tests
plugins: allure-pytest-2.8.4
collected 2772 items / 2 deselected / 2770 selected

maxim-zaitsev · 2019-10-16T08:58:34Z

Really?

pytest --help

...
--allure-link-pattern=LINK_TYPE:LINK_PATTERN
                        Url pattern for link type. Allows short links in test,
                        like 'issue-1'. Text will be formatted to full url
                        with python str.format().
...

So this parameter does not filter tests, it's for short testcase link in the report

By the way I'm also looking for a way to run tests based on allure testcase link...

sseliverstov · 2019-10-16T09:54:43Z

@maxim-zaitsev links are marks too: https://github.com/allure-framework/allure-python/blob/master/allure-pytest/src/helper.py#L36, so you can implement filtering with pytest hook pytest_collection_modifyitems. Something like this https://github.com/allure-framework/allure-python/blob/master/allure-pytest/src/plugin.py#L142

eskignax · 2020-06-25T02:04:48Z

I use this in my code to make it possible to trigger test by test case id from the allure test case link : https://docs.pytest.org/en/stable/example/markers.html#custom-marker-and-command-line-option-to-control-test-runs.

But would be nice to have this feature in the allure-python package directly (since you already have it for Epic ).

allure-framework / allure-python

--allure-link-pattern option don't filter any test. #433

--allure-link-pattern option don't filter any test. #433

eskignax commented Oct 1, 2019 •

edited

maxim-zaitsev commented Oct 16, 2019

sseliverstov commented Oct 16, 2019

eskignax commented Jun 25, 2020

allure-framework / allure-python

Join GitHub today

GitHub is where the world builds software

--allure-link-pattern option don't filter any test. #433

--allure-link-pattern option don't filter any test. #433

Comments

eskignax commented Oct 1, 2019 • edited

I'm submitting a ...

What is the current behavior?

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem

What is the expected behavior?

Please tell us about your environment:

Other information

maxim-zaitsev commented Oct 16, 2019

sseliverstov commented Oct 16, 2019

eskignax commented Jun 25, 2020

Essential cookies

Always active

Analytics cookies

eskignax commented Oct 1, 2019 •

edited