[Fuego] release test issues

Mon Feb 26 18:52:30 UTC 2018

> -----Original Message-----
> From: Guilherme Camargo [mailto:guicc at profusion.mobi]
> Sent: Monday, February 26, 2018 10:31 AM
> To: Bird, Timothy <Tim.Bird at sony.com>
> Cc: fuego at lists.linuxfoundation.org
> Subject: Re: [Fuego] release test issues
> 
> Hello, Tim
> 
> Hope everything is going well.
> 
> Did you have the chance to run the test again?

I ran it just now...

Good news!!  Jenkins starts in the container, and the fuego-test.default./Functional.fuegotest
job is created.

When I build that job in Jenkins, it immediately fails, and I get the following error message
in the console log (this is a copy paste from the Jenkins interface):

A problem occurred while processing the request. Please check our bug tracker to see if a similar problem has already been reported. If it is already reported, please vote and put a comment on it to let us gauge the impact of the problem. If you think this is a new issue, please file a new issue. When you file an issue, make sure to add the entire stack trace, along with the version of Jenkins and relevant plugins. The users list might be also useful in understanding what has happened.

Stack trace

javax.servlet.ServletException: org.apache.commons.jelly.JellyTagException: jar:file:/var/cache/jenkins/war/WEB-INF/lib/jenkins-core-2.32.1.jar!/hudson/model/Run/console.jelly:65:27: <j:whitespace> Failed to load the key: hudson.console.AnnotatedLargeText.consoleAnnotator
	at org.kohsuke.stapler.jelly.JellyFacet$1.dispatch(JellyFacet.java:103)
	at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
	at org.kohsuke.stapler.MetaClass$10.dispatch(MetaClass.java:362)
	at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
	at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
	at org.kohsuke.stapler.MetaClass$5.doDispatch(MetaClass.java:236)
	at
... (lots more traceback).

------------
If I look at /var/lib/jenkins/jobs/fuego-test.default.Functional.fuegotest/builds/3/log, I see the following:

Started by user ^[[8mha:AAAAlh+LCAAAAAAAAP9b85aBtbiIQTGjNKU4P08vOT+vOD8nVc83PyU1x6OyILUoJzMv2y+/JJUBAhiZGBgqihhk0NSjKDWzXb3RdlLBUSYGJk8GtpzUvPSSDB8G5tKinBIGIZ+sxLJE/ZzEvHT94JKizLx0a6BxUmjGOUNodHsLgAzOEgYu/dLi1CL9vNKcHACFIKlWvwAAAA==^[[0manonymous
Building remotely on ^[[8mha:AAAAoB+LCAAAAAAAAP9b85aBtbiIQTGjNKU4P08vOT+vOD8nVc83PyU1x6OyILUoJzMv2y+/JJUBAhiZGBgqihhk0NSjKDWzXb3RdlLBUSYGJk8GtpzUvPSSDB8G5tKinBIGIZ+sxLJE/ZzEvHT94JKizLx0a6BxUmjGOUNodHsLgAyuEgYR/eT83ILSktQi/bTS1PR83ZLU4hIADoGZQ8kAAAA=^[[0mfuego-testFATAL: Failed to load the key: hudson.model.Job.serverCookie
^[[8mha:AAAAWB+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0ldFVf2c+b/lb5MDAwVRQxSaBqcITRIIQMEMIIUFgAAckCEiWAAAAA=^[[0mjava.lang.Error: Failed to load the key: hudson.model.Job.serverCookie
        at jenkins.security.HexStringConfidentialKey.get(HexStringConfidentialKey.java:62)
        at hudson.model.Job.getCharacteristicEnvVars(Job.java:367)
        at hudson.model.Job.getEnvironment(Job.java:395)
        at hudson.model.AbstractProject.getEnvironment(AbstractProject.java:353)
        at hudson.model.Run.getEnvironment(Run.java:2264)
        at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:922)
        at hudson.model.AbstractBuild$AbstractBuildExecution.decideWorkspace(AbstractBuild.java:478)
        at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:518)
        at hudson.model.Run.execute(Run.java:1728)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:98)
        at hudson.model.Executor.run(Executor.java:404)
Caused by: java.io.FileNotFoundException: /var/lib/jenkins/secrets/hudson.model.Job.serverCookie (Permission denied)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:171)
        at jenkins.security.DefaultConfidentialStore.store(DefaultConfidentialStore.java:79)
        at jenkins.security.ConfidentialKey.store(ConfidentialKey.java:50)
        at jenkins.security.HexStringConfidentialKey.get(HexStringConfidentialKey.java:54)
        ... 11 more
FATAL: Failed to load the key: hudson.model.Job.serverCookie
^[[8mha:AAAAWB+LCAAAAAAAAP9b85aBtbiIQSmjNKU4P08vOT+vOD8nVc8DzHWtSE4tKMnMz/PLL0ldFVf2c+b/lb5MDAwVRQxSaBqcITRIIQMEMIIUFgAAckCEiWAAAAA=^[[0mjava.lang.Error: Failed to load the key: hudson.model.Job.serverCookie
        at jenkins.security.HexStringConfidentialKey.get(HexStringConfidentialKey.java:62)
        at hudson.model.Job.getCharacteristicEnvVars(Job.java:367)
        at hudson.model.Job.getEnvironment(Job.java:395)
        at hudson.model.AbstractProject.getEnvironment(AbstractProject.java:353)
        at hudson.model.Run.getEnvironment(Run.java:2264)
        at hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:922)
        at hudson.plugins.descriptionsetter.DescriptionSetterHelper.setDescription(DescriptionSetterHelper.java:53)
        at hudson.plugins.descriptionsetter.DescriptionSetterPublisher.perform(DescriptionSetterPublisher.java:70)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:779)
        at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:720)
        at hudson.model.Build$BuildExecution.post2(Build.java:185)
        at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:665)
        at hudson.model.Run.execute(Run.java:1753)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:98)
        at hudson.model.Executor.run(Executor.java:404)
Caused by: java.io.FileNotFoundException: /var/lib/jenkins/secrets/hudson.model.Job.serverCookie (Permission denied)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:171)
        at jenkins.security.DefaultConfidentialStore.store(DefaultConfidentialStore.java:79)
        at jenkins.security.ConfidentialKey.store(ConfidentialKey.java:50)
        at jenkins.security.HexStringConfidentialKey.get(HexStringConfidentialKey.java:54)
        ... 16 more
Finished: FAILURE

----------
Let me know if there is more information I can provide.

BTW - I tried to copy the log file to /fuego-rw/transfer so I could extract it from the container,
but I can't find fuego-rw on my host that corresponds to this.  Where would this directory
be located, in the release test configuration of the containers?
 -- Tim