Category: test

PLATFORM DEVOPS Smoke Test

Prerequisites

• Target skill: skills/platform/devops/alicloud-platform-devops/.
• Optional online SDK test dependency:

python -m pip install -U alibabacloud_devops20210625 alibabacloud_tea_openapi

Test Steps

1. Run offline script compilation check:

python3 tests/common/compile_skill_scripts.py \
  --skill-path skills/platform/devops/alicloud-platform-devops \
  --output output/alicloud-platform-devops-test/compile-check.json

2. Run metadata API discovery script:

python3 skills/platform/devops/alicloud-platform-devops/scripts/list_openapi_meta_apis.py \
  --product-code devops \
  --version 2021-06-25 \
  --output-dir output/alicloud-platform-devops-test

3. Verify generated files and API count:

test -f output/alicloud-platform-devops-test/devops_2021-06-25_api_docs.json
test -f output/alicloud-platform-devops-test/devops_2021-06-25_api_list.md
rg -n "API count: [1-9][0-9]*" output/alicloud-platform-devops-test/devops_2021-06-25_api_list.md

4. Save request summary, response summary, and raw output under output/alicloud-platform-devops-test/.

Optional Online Read-only Check

Set one organization id:

export DEVOPS_ORGANIZATION_ID=<organization-id>

Run bounded read-only calls:

python3 skills/platform/devops/alicloud-platform-devops/scripts/list_projects.py \
  --organization-id \"$DEVOPS_ORGANIZATION_ID\" \
  --max-results 10 \
  --json \
  --output output/alicloud-platform-devops-test/list-projects.json

python3 skills/platform/devops/alicloud-platform-devops/scripts/list_repositories.py \
  --organization-id \"$DEVOPS_ORGANIZATION_ID\" \
  --page 1 \
  --per-page 10 \
  --json \
  --output output/alicloud-platform-devops-test/list-repositories.json

python3 skills/platform/devops/alicloud-platform-devops/scripts/list_pipelines.py \
  --organization-id \"$DEVOPS_ORGANIZATION_ID\" \
  --max-results 10 \
  --json \
  --output output/alicloud-platform-devops-test/list-pipelines.json

Verify basic response structure:

rg -n '\"requestId\"|\"success\"|\"errorCode\"|\"errorMessage\"' \
  output/alicloud-platform-devops-test/list-projects.json \
  output/alicloud-platform-devops-test/list-repositories.json \
  output/alicloud-platform-devops-test/list-pipelines.json

Pass Criteria

• Script compilation check passes (compile-check.json.status=pass).
• Metadata API discovery succeeds and produces both JSON and markdown output files.
• API list markdown shows a positive API count.
• Evidence files exist in output/alicloud-platform-devops-test/.
• Optional online read-only check returns valid response structures.

Result Template

• Date: YYYY-MM-DD
• Skill: skills/platform/devops/alicloud-platform-devops
• Conclusion: pass / fail
• Notes: