Hi, One of the reasons why the templates may not be showing up in the VM deployment wizard is because they aren't in the ready state. You can verify that by going into the respective template's info and in the zone tab you'd probably notice that the template(s) aren't in ready state. Ideally, once the SystemVMs, essentially, Secondary storage VM(SSVM) is up, it should sync the templates (the systemVM template (that you had initially seeded) and the built-in template). Do you see an errors in the management server logs that could be helpful. Can you log into your database (cloud) and see if you see any entries in the template_store_ref table. I understand you are on a KVM based env, so, select * from template_store_ref where template_id=4\G - template_id = 4 - refers to a built-in template that gets downloaded.
Do you see any exceptions when trying to register a new template ? For management server logs - look into /var/log/cloudstack/management/management-server.log Another place to look at would be the SSVM (which plays an integral role in downloading templates) Please refer to https://cwiki.apache.org/confluence/display/CLOUDSTACK/SSVM%2C+templates%2C+Secondary+storage+troubleshooting to log into and debug the SSVM. To increase the log level in your SSVM - you can run the following: sed -i 's/INFO/DEBUG/g' /usr/local/cloud/systemvm/conf/log4j-cloud.xml and then restart the cloud service : systemctl restart cloud In the SSVM, you can observe the logs at /var/log/cloud.log To setup an SSL enabled env you could follow this link - https://www.shapeblue.com/securing-cloudstack-4-11-with-https-tls/ or as a temporary hack, you can enter the SSVMs IP Address in the browser's url field with https scheme (https://<IP Address>) and accept the risk, before trying to upload the template. Hope this helps. Thanks ________________________________ From: DL <douglasl...@gmail.com> Sent: Tuesday, September 21, 2021 10:51 AM To: users@cloudstack.apache.org <users@cloudstack.apache.org> Subject: Re: Problem with Templates/ISO The system VMs are up and running. The Zone shows enabled. I have another VM in VirtualBox serving as the gateway server for the cloudstack VM. The gateway IP is 172.16.10.1. The cloudstack VM's IP is 172.16.10.2. As instructed, the gateway server is only a gateway, not a DHCP server. The cloudstack VM can use the gateway to access the Internet fine. I can SSH from the gateway server into the cloudstack VM fine. How do I make my env setup SSL enabled? Am I supposed to see some existing Templates/ISOs when creating a new VM instance? Or am I supposed to create some Templates/ISOs by myself first? On Tue, Sep 21, 2021 at 12:20 AM Pearl d'Silva <pearl.dsi...@shapeblue.com<mailto:pearl.dsi...@shapeblue.com>> wrote: Hi Douglas, Could you please let us know the following: * Do you see the systemVMs are up and running (Infratructure -> System VMs)? * Is the zone enabled? (Infrastructure -> Zones (specific zone's Allocation State)) Providing some insight into the state of your env - by answering the above questions, may help us diagnose the issue better wrt template registration failure. With regards to template/iso upload(from local) failure - this would be expected if your env setup isn't SSL enabled. The issues you may be facing could also be due to your infrastructure / network topology. The Quick installation guide is up to date and should work, however if you are facing issues you may refer to https://github.com/shapeblue/hackerbook/blob/main/1-user.md to setup a basic env. Another resource you could look at is https://github.com/shapeblue/mbx - this will setup an env for you - please do follow the Readme. That said, if you see any issues with the documentation, you can report them i.e., create an issue/ pull request against the respective projects on GitHub and we can help improve them. Thanks, Pearl ________________________________ From: DL <douglasl...@gmail.com<mailto:douglasl...@gmail.com>> Sent: Tuesday, September 21, 2021 12:43 AM To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> <users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>> Subject: Re: Problem with Templates/ISO Hi Pearl, Following your solution, I added the Secondary Storage, and now two Templates and two ISOs shows under the Images tab. However, I still couldn't see any Templates/ISOs in the Template/ISO configuration page when I tried to create a new VM instance. I tried to Register ISO also. If I use an online ISO, cloudstack would show me that the url hostname cannot be resolved. (Of course, I can use the browser to download the ISO fine) If I want to upload an ISO from the local machine, cloudstack would report an error saying that it cannot reach the management server (or some web browser extensions may have blocked the request). I have a single machine doing all the things. I also checked that all required processes are running. My browser doesn't use any extensions. I am using a CentOS 7 virtual machine within VirtualBox to follow the Quick Installation Guide ( http://docs.cloudstack.apache.org/en/latest/quickinstallationguide/qig.html ). I have made everything identical to that of the Quick Installation Guide. However, I still encountered various issues. The first issue is that after I configured the Zone, Pod, Cluster, etc, and launched the Zone, every time (I have done this with multiple VMs) the system would hang at the last step "Adding Host" forever. I really mean forever. And it didn't even report what error it encountered. I have to close the window. After this, I would see, the host has been added to the Zone successfully. However, the Primary Storage and the Secondary Storage were not added. I believe this is why I needed to add the Secondary Storage (and also the Primary Storage) manually. But after this, I still could not see/add any Templates/ISOs. I didn't expect so many issues by just following the simplest Quick Installation Guide. Is there anything I should pay special attention to while following the Quick Installation Guide? Does the Quick Installation Guide still work for the latest version? I do notice that the instructions don't mention some options I was faced with during the installation/configuration process. I just chose default options. Would this cause any issues? Are there any better Installation Guides I should try instead? Are there any existing clouds (built with CloudStack) that I can play with for free (or with minimal costs)? Sorry for asking so many questions. I just want to get started. Best regards, On Mon, Sep 20, 2021 at 12:55 AM Pearl d'Silva <pearl.dsi...@shapeblue.com<mailto:pearl.dsi...@shapeblue.com>> wrote: > Hi Douglas, > > > That seems to be the issue, you will need to add a store to the zone. You > can do that either via UI / command line. On the UI, there is the "Add > Secondary Storage" button, provide the zone, the server IP/name, and the > path (in your case, /export/secondary). > > > Thanks, > Pearl > ________________________________ > From: DL <douglasl...@gmail.com<mailto:douglasl...@gmail.com>> > Sent: Monday, September 20, 2021 10:16 AM > To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> > <users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>> > Subject: Re: Problem with Templates/ISO > > @Pearl > I can go to the Infrastructure -> Secondary Storage tab. However, nothing > is there. > > @Harikrishna > Thank you also for getting back to me! > > Here is what I found related to the error in the log: > > 2021-09-20 00:27:12,093 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-20:ctx-d9bd1f44) (logid:a56ace1d) ===START=== 172.16.10.2 > -- GET > > > listall=true&templatefilter=all&showunique=true&page=1&pagesize=20&command=listTemplates&response=json > 2021-09-20 00:27:12,097 DEBUG [c.c.a.ApiServer] > (qtp1136768342-20:ctx-d9bd1f44 ctx-931ef03f) (logid:a56ace1d) CIDRs from > which account 'Acct[2e801633-1977-11ec-98da-5254005ad990-admin]' is allowed > to perform API calls: 0.0.0.0/0,::/0<http://0.0.0.0/0,::/0> > 2021-09-20 00:27:12,110 ERROR [c.c.a.ApiServer] > (qtp1136768342-20:ctx-d9bd1f44 ctx-931ef03f) (logid:a56ace1d) unhandled > exception executing api command: [Ljava.lang.String;@421e6f13 > com.cloud.utils.exception.CloudRuntimeException: DB Exception on: > com.mysql.cj.jdbc.ClientPreparedStatement: SELECT > template_store_ref.id<http://template_store_ref.id>, > template_store_ref.store_id, template_store_ref.template_id, > template_store_ref.store_role, template_store_ref.created, > template_store_ref.last_updated, template_store_ref.download_pct, > template_store_ref.size, template_store_ref.physical_size, > template_store_ref.download_state, template_store_ref.local_path, > template_store_ref.error_str, template_store_ref.job_id, > template_store_ref.install_path, template_store_ref.url, > template_store_ref.download_url, template_store_ref.download_url_created, > template_store_ref.is_copy, template_store_ref.destroyed, > template_store_ref.update_count, template_store_ref.updated, > template_store_ref.state, template_store_ref.ref_cnt FROM > template_store_ref WHERE template_store_ref.template_id = 3 AND > template_store_ref.download_state != 'BYPASSED' AND > template_store_ref.destroyed = 0 AND template_store_ref.store_id IN ) > at > > com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:423) > at > > com.cloud.utils.db.GenericDaoBase.searchIncludingRemoved(GenericDaoBase.java:359) > at com.cloud.utils.db.GenericDaoBase.search(GenericDaoBase.java:348) > at com.cloud.utils.db.GenericDaoBase.search(GenericDaoBase.java:1308) > at > > org.apache.cloudstack.storage.image.db.TemplateDataStoreDaoImpl.listByTemplateNotBypassed(TemplateDataStoreDaoImpl.java:431) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > at > > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at > > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > at > > com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) > at > > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) > at > > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) > at com.sun.proxy.$Proxy79.listByTemplateNotBypassed(Unknown Source) > at > > com.cloud.api.query.dao.TemplateJoinDaoImpl.newTemplateResponse(TemplateJoinDaoImpl.java:165) > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > at > > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at > > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > at > > com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) > at > > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) > at > > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) > at com.sun.proxy.$Proxy308.newTemplateResponse(Unknown Source) > at com.cloud.api.ApiDBUtils.newTemplateResponse(ApiDBUtils.java:2022) > at > > com.cloud.api.query.ViewResponseHelper.createTemplateResponse(ViewResponseHelper.java:590) > at > > com.cloud.api.query.QueryManagerImpl.listTemplates(QueryManagerImpl.java:3336) > at > > org.apache.cloudstack.api.command.user.template.ListTemplatesCmd.execute(ListTemplatesCmd.java:180) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156) > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:764) > at com.cloud.api.ApiServer.handleRequest(ApiServer.java:588) > at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:321) > at com.cloud.api.ApiServlet$1.run(ApiServlet.java:134) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102) > at > > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52) > at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:131) > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:93) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:645) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:750) > at > > org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1443) > at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:791) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550) > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) > at > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) > at > > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1435) > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) > at > > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) > at > > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1350) > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) > at > > org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:766) > at > > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) > at org.eclipse.jetty.server.Server.handle(Server.java:516) > at > org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) > at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) > at > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) > at > org.eclipse.jetty.io<http://org.eclipse.jetty.io> > .AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) > at > org.eclipse.jetty.io<http://org.eclipse.jetty.io>.FillInterest.fillable(FillInterest.java:105) > at > org.eclipse.jetty.io<http://org.eclipse.jetty.io>.ChannelEndPoint$1.run(ChannelEndPoint.java:104) > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) > at > > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) > at > > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) > at > > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) > at java.base/java.lang.Thread.run(Thread.java:829) > Caused by: java.sql.SQLSyntaxErrorException: You have an error in your SQL > syntax; check the manual that corresponds to your MySQL server version for > the right syntax to use near ')' at line 1 > at > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:120) > at > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) > at > > com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) > ... 87 more > 2021-09-20 00:27:12,122 DEBUG [c.c.a.ApiServlet] > (qtp1136768342-20:ctx-d9bd1f44 ctx-931ef03f) (logid:a56ace1d) ===END=== > 172.16.10.2 -- GET > > > listall=true&templatefilter=all&showunique=true&page=1&pagesize=20&command=listTemplates&response=json > > > Could you help me to pinpoint what I may have done wrong? > > On Mon, Sep 20, 2021 at 12:38 AM Harikrishna Patnala < > harikrishna.patn...@shapeblue.com<mailto:harikrishna.patn...@shapeblue.com>> > wrote: > > > Sorry, logs at /var/log/cloudstack/management/management-server.log > > ________________________________ > > From: Harikrishna Patnala > > <harikrishna.patn...@shapeblue.com<mailto:harikrishna.patn...@shapeblue.com>> > > Sent: Monday, September 20, 2021 10:04 AM > > To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> > > <users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>> > > Subject: Re: Problem with Templates/ISO > > > > > > Hi Douglas, > > > > Firstly, welcome to CloudStack. > > > > This looks to me like DB changes did not apply properly during > > installation. Did you observe any issues in the logs during the > management > > server installation or start. > > > > You can check the logs at > > /usr/share/cloudstack/management/management-server.log and see the exact > > reason for DB sql exception when you perform the list templates > operation. > > > > As mentioned already there is no change in the system VM template from > > 4.15.1 to 4.15.2 > > > > Regards, > > Harikrishna > > ________________________________ > > From: DL <douglasl...@gmail.com<mailto:douglasl...@gmail.com>> > > Sent: Monday, September 20, 2021 9:38 AM > > To: users@cloudstack.apache.org<mailto:users@cloudstack.apache.org> > > <users@cloudstack.apache.org<mailto:users@cloudstack.apache.org>> > > Subject: Problem with Templates/ISO > > > > Hello there, > > > > I am a new CloutStack user and a new user on this mailing list. After > > following the Quick Installation Guide, I ended up with empty > Template/ISOs > > when I attempted to create a VM instance. > > > > If I go to Images/Templates, I got 500 Internal Server Error: > > > > Request Failed (530) > > DB Exception on: com.mysql.cj.jdbc.ClientPreparedStatement: SELECT > > template_store_ref.id<http://template_store_ref.id>, > > template_store_ref.store_id, > > template_store_ref.template_id, template_store_ref.store_role, > > template_store_ref.created, template_store_ref.last_updated, > > template_store_ref.download_pct, template_store_ref.size, > > template_store_ref.physical_size, template_store_ref.download_state, > > template_store_ref.local_path, template_store_ref.error_str, > > template_store_ref.job_id, template_store_ref.install_path, > > template_store_ref.url, template_store_ref.download_url, > > template_store_ref.download_url_created, template_store_ref.is_copy, > > template_store_ref.destroyed, template_store_ref.update_count, > > template_store_ref.updated, template_store_ref.state, > > template_store_ref.ref_cnt FROM template_store_ref WHERE > > template_store_ref.template_id = 3 AND template_store_ref.download_state > != > > 'BYPASSED' AND template_store_ref.destroyed = 0 AND > > template_store_ref.store_id IN ) > > > > Could someone help me fix this issue? > > > > The quick installation guide I followed says it is for 4.15.2.0 > > installation. However, in the System Template Setup section, this > command: > > """ > > > > > /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt > > -m /export/secondary -u > > > > > https://download.cloudstack.org/systemvm/4.15/systemvmtemplate-4.15.1-kvm.qcow2.bz2 > > -h > > < > https://download.cloudstack.org/systemvm/4.15/systemvmtemplate-4.15.1-kvm.qcow2.bz2-h > > > > kvm -F > > """ > > seems to suggest that the process will download template vms for the > > 4.15.1.0 version? > > > > Could this be the reason? Does anyone have an idea about when the > Template > > for the 4.15.2.0 version will be available? > > > > Best regards, > > Douglas > > > >
