在节点上并行执行创建多个阶段

我们的跨平台项目要求Jenkins在多个不同的平台上执行，并为每个平台执行适当的测试和打包。我能够将parallel与node结合，但只能在一个单独的stage中得到这个结果（见下文）在节点上并行执行创建多个阶段

我希望能够将它分解成多个阶段。阶段我想创建是：

构建：构建库/项目W /文物
单元测试：编译和运行单元测试
TestApp：构建和运行测试应用W /文物
输入阶段：想要上传？
上传：（使用stash）
那就需要保持对node使用一致性
1. 复制一堆阶段间的对象：上传文物外部服务器

请问我可以做以下。（在节点label上生成的对象应相应标记为在适当节点label上不加标签）。我需要为每个节点唯一标记每个节点。

这不是更加低效吗？我会人为地复制大量数据，以便创建阶段。

def checkoutAndBuild(Map args) { 
    node("${args.nodeName}") { 

     checkout([$class: 'GitSCM', 
        branches: scm.branches, 
        doGenerateSubmoduleConfigurations: scm.doGenerateSubmoduleConfigurations, 
        extensions: scm.extensions + 
           [[$class: 'SubmoduleOption', 
            disableSubmodules: false, 
            parentCredentials: false, 
            recursiveSubmodules: true, 
            reference: '', 
            trackingSubmodules: false]] + 
           [[$class: 'CleanCheckout']], 
        userRemoteConfigs: scm.userRemoteConfigs 
       ]) 

     step([$class: 'CopyArtifact', 
      filter: "AppCommon/*/**, cmake/**/*, core/**/*, thirdparty/prebuilt/${args.prebuiltDir}/**/*, tools/**/*", 
      fingerprintArtifacts: true, 
      projectName: "${args.engineDependency_Job}", 
      selector: [$class: 'SpecificBuildSelector', buildNumber: "${args.engineDependency_BuildNo}"], 
      target: 'engine']) 

     dir("build/${args.buildDir}") { 
      echo 'Building..' 
      if (isUnix()) { 
       sh './build.sh Release' 
      } else { 
       bat 'build.bat Release' 
      } 
     } 

     def extras = args.additionalArtifacts ? ", ${args.additionalArtifacts}" : "" 
     archiveArtifacts artifacts: "dist/**/*${extras}", fingerprint: true 

     dir("test/build") { 
      echo 'Building test App' 
      sh "./full.sh ${args.buildDir} Release" 
     } 
    } 
} 

pipeline { 
    agent none 

    stages { 
     stage('Info') { 
      agent any 
      steps { 
       echo "Running ${env.JOB_NAME}/${env.BUILD_ID} on ${env.JENKINS_URL}" 
      } 
     } 

     stage('Build') { 
      steps { 
       parallel (
        ios: { 
         checkoutAndBuild nodeName: 'iOS', prebuiltDir: 'ios', buildDir: 'ios', engineDependency_Job: 'engine_iOS_Release', engineDependency_BuildNo: String.valueOf(engineBuild.ios) 
        }, 
        tvos: { 
         checkoutAndBuild nodeName: 'tvOS', prebuiltDir: 'tvos', buildDir: 'tvos', engineDependency_Job: 'engine_tvOS_Release', engineDependency_BuildNo: String.valueOf(engineBuild.tvos) 
        }, 
        android: { 
         checkoutAndBuild nodeName: 'Android', prebuiltDir: 'android', buildDir: 'AndroidNative', engineDependency_Job: 'engine_Android_Release', engineDependency_BuildNo: String.valueOf(engineBuild.android), additionalArtifacts: 'src/java/*' 
        }) 
      } 
     } 
     stage('Test Build') { 
      steps { 
       echo 'Testing...' 
      } 
     } 

     stage('Deploy') { 
      steps { 
       echo 'Deploying...' 
      } 
     } 

    } 

    post { 
     success { 
      slackSend channel: '#builds', 
         color: 'good', 
         message: "${currentBuild.fullDisplayName} succeeded. (<${env.BUILD_URL}|Open>)" 

     } 
     failure { 
      slackSend channel: '#builds', 
         color: 'danger', 
         message: "${currentBuild.fullDisplayName} failed. (<${env.BUILD_URL}|Open>)" 
     } 
    } 
}

来源

2017-04-12 Arcin B

不幸的是，声明式管道语法在你的情况下不是很灵活。在舞台之间囤积物体会非常沉重，并且会导致进入同步阶段，其中最快的构建目标是在每个阶段之前等待较慢的目标。

如果您不需要同步运行阶段，我建议创建一个包含所有构建目标的所有阶段的大方法，这些目标是您希望并行运行的阶段。为了区分各个阶段，您可以将节点名称附加到每个阶段标签。

def checkoutBuildTestDeploy(Map args) { 
    node("${args.nodeName}") { 

     stage("Build ${args.nodeName}") { 
      checkout([$class: 'GitSCM', ... ]) 
      // And other build steps ... 
     } 
     stage("Unit test ${args.nodeName}") { 
      // Unit test steps 
     } 
     stage("Test app ${args.nodeName}") { 
      // Test steps 
     } 
     stage("Deploy ${args.nodeName}") { 
      // Input answer and upload 
     } 
    } 
} 

pipeline { 
    agent none 
    stages { 
     stage('Info') { 
      agent any 
      steps { 
       echo "Running ${env.JOB_NAME}/${env.BUILD_ID} on ${env.JENKINS_URL}" 
      } 
     } 

     stage('Run builds parallel') { 
      steps { 
       parallel (
        ios: { 
         checkoutBuildTestDeploy nodeName: 'iOS', prebuiltDir: 'ios', buildDir: 'ios', engineDependency_Job: 'engine_iOS_Release', engineDependency_BuildNo: String.valueOf(engineBuild.ios) 
        }, 
        tvos: { 
         checkoutBuildTestDeploy nodeName: 'tvOS', prebuiltDir: 'tvos', buildDir: 'tvos', engineDependency_Job: 'engine_tvOS_Release', engineDependency_BuildNo: String.valueOf(engineBuild.tvos) 
        }, 
        android: { 
         checkoutBuildTestDeploy nodeName: 'Android', prebuiltDir: 'android', buildDir: 'AndroidNative', engineDependency_Job: 'engine_Android_Release', engineDependency_BuildNo: String.valueOf(engineBuild.android), additionalArtifacts: 'src/java/*' 
        }) 
      } 
     } 
    } 
    post { 
     success { 
      slackSend channel: '#builds', 
         color: 'good', 
         message: "${currentBuild.fullDisplayName} succeeded. (<${env.BUILD_URL}|Open>)" 

     } 
     failure { 
      slackSend channel: '#builds', 
         color: 'danger', 
         message: "${currentBuild.fullDisplayName} failed. (<${env.BUILD_URL}|Open>)" 
     } 
    } 
}

来源

2017-04-14 21:15:35 Travenin

在节点上并行执行创建多个阶段

回答

相关问题