Original Message
Subject: TAC supporting Berlin Buzzwords
Date: 2023-03-24 05:56
From: Gavin McDonald
To: gmcdon...@apache.org
Reply-To: priv...@jclouds.apache.org
PMCs,
Please forward to your dev and user lists.
Hi All,
The ASF Travel Assistance Committee is supporting
Should I report this as an issue in the jclouds tracker?
That would be useful, yes, especially if you have any thoughts around
how this could reliably be reproduced.
If you have a fix in mind, a test and pull request would definitely also
be great.
Thanks for reporting this!
ap
Also +1 - thanks for kicking off this thread!
ap
But clicking on those you get a 404... Probably something wrong with
the Apache snapshots repo to be taken to ASF infra?
Is this the right thing for an INFRA ticket?
@Timur: thanks for flagging this!
ap
These bindings add to jclouds maintenance and make evolving core APIs
harder. Further they really belong outside of the jclouds repository.
I would like to remove these in 2.1.0
+1 to remove. It should be easy enough to keep them in a separate
repository dependent on jclouds, if desired. Is
Hi Ashkan
* Failed in command: …., org.jclouds.http.HttpResponseException:
command: POST https://identity.api.rackspacecloud.com/v2.0/tokens
HTTP/1.1 failed with response: HTTP/1.1 400 Bad Request; content:
[{"badRequest":{"code":400,"message":"Invalid json request body"}}]
Could you
[forwarding to user@...]
Original Message
Subject: Jclouds with HDFS file system
Date: 2017-03-22 22:43
From: Chaitanya Anumalasetty
To: andr...@apache.org
Hi Andrew,
I need one example Java code to upload/download file from HDFS file
system using
so which version do i need to use ?
The version of jclouds you are pulling in was compiled against Guava
16.0.1; from the output your provided, it appears that your code is
trying to use Guava 18.0, which seems to be coming from spark-core.
Two options I can think of are:
1. Exclude Guava
Hi Rupinder
I did that too. Same results. I'll send the output later in evg.
Could you try a cURL or similar from the box, with appropriate headers
etc., to verify whether the TryStack endpoint is responding correctly if
we take jclouds out of the loop?
Thanks!
ap
Er, that should have been "user@..." - sorry!
ap
Original Message
Subject: Re:Is there any way to add custom headers on HTTP headers to
Rackspace Cloudfiles?
Date: 2017-02-02 15:59
From: Andrew Phillips <andr...@apache.org>
To: us...@jclouds.apache
I was completely confused by being directed to the github for the
azurecompute-arm as I thought that was an example I should be
following.
Thanks for the update! Are things working now, or is there still
something that's not doing what it should?
Also, do you have any thoughts on what we
But in the end, like in any Java project, the only thing you
need to use jclouds is your project is to have the jclouds .jar
files in your classpath.
Just for the avoidance of doubt: you will need the jclouds JAR files and
the JARs for any dependencies needed by the particular jclouds JARs you
Hi Teo
The jclouds-examples repo [1] may help - I don't think it has an
Azure-specific example at present, but the general "compute-basics" app
should hopefully give a better idea of how the end-to-end flow might
look like:
Hi all
Just wanted to share a nice interview in JAXenter with Ignasi about
Apache jclouds:
https://jaxenter.com/jclouds-project-devops-130667.html
Apart from anything else, I think it's a great example of how we can
explain collaborative work on projects at Apache and educate the media
and
Hi Ken
I haven't made a break through on this yet. Any pointers will be very
useful.
Thanks for the ping - sorry to hear things are still not working. I hope
someone on this list with more knowledge of the Openstack provider will
be able to help; I just wanted to point out that there may be
Hi Ken
I want to use Jcloud swift and nova, the connection always time outs
after
successfully authenticating...
Could you provide a short code sample (with passwords etc. obfuscated)
to help us understand how the connection is configured?
Regards
ap
Hi Dileep
Due to Various security vulnerabilities, Many Servers supports/enables
only TLS1.2 Protocols.
ApacheHCHttpCommandExecutorServiceModule Needs change to support
TLS1.2 Protocols only.
Have you considered using the OkHttp driver [1] instead? As far as I
recall, that should allow you
But I got an error:
Ah, sorry to hear :-( Glad we're getting closer, though.
Could you enable header and wire logging [1], run the request again and
please put the output (with sensitive information removed) into a Gist
or Pastie?
That will hopefully give us a bit more insight into the
What is "RegionOne" ? First of all if we talk about regions in Swift
then it can't be a String. It is Integer value. That is why I can't
understand what is "RegionOne" and how to create a simple container
with SwiftApi.
Could you call "getConfiguredRegions" on your API instance to see which
mvn clean package -DskipTests &> mvncleanout1 attached.
So close, this time!
[INFO] all ... SUCCESS
[1.144s]
[INFO] Apache jclouds FAILURE
[2.181s]
From the logs, it appears that the code you are building is
The final compilation output is
Could you please run 'mvn clean package -DskipTests' from the root of
the project and put the *full* output (including progress, as in the
last attachment) in a Gist or Pastie?
Thanks!
ap
Hi Sathish
Can you please help us when we can expect jcloud 2.0.0-SNAPSHOT
official release.
2.0.0-SNAPSHOTs are already being published and are available from [1].
See also the section "Using the daily builds" from the installation
guide [2].
For information about the progress of the 2.0
Hi Pratheesh
Could you enable wire and header logging (see [1]) and send us the
output, so we can get some more details on the call that is being made?
Could you also provide a minimal, if possible, test case that
demonstrates the problem you're seeing?
Regards
ap
[1]
Caused by: java.lang.NoClassDefFoundError: Could not initialize class
org.jclouds.reflect.Reflection2
That class is in jclouds-core-1.9.1.jar, so you shouldn't really get
that exception. Can you share the actual classpath is that is used when
the code is run?
Regards
ap
and files. Maybe it's a Windows 7 specialty when not using the Windows
temp directory? Where are the ITs putting their stuff for testing? Are
there even Windows related tests for the Filesystem storage provider
;)?
There are indeed a number of filesystem tests, although many of them are
On 2016-03-20 10:00, cen wrote:
Agree with both statements. If there was documentation about this on
createSecurityGroup I'd knew instantly what is going on. It could even
be a generic statement that a certain method adheres to
GroupNamingConvention.
The pattern does not really match my use
Regarding the group name in the nodes, could you share the code you
use to build the template, including the template options?
Thanks for the additional details! More information on the resource
prefixing Ignasi was mentioning is here, by the way:
After changing the group name in template to "jclouds#crossbuild" it
started working.
Ah, glad to hear! Could you share your final code and perhaps a short
description of "this is what I was trying to do, this approach didn't
work, this different approach did"? I suspect that may turn into
Hi Stéphane
Any idea of code to configure my http client with TLSv1.1 or TLSv1.2
instead of TLSv1.0, please ?
The following blog post doesn't provide a step-by-step solution, but
should hopefully help:
https://jclouds.apache.org/blog/2014/10/25/poodle-and-jclouds/
Regards
ap
ists(bucket);
I also have VM args:
-Djclouds.trust-all-certs=true -Djclouds.relax-hostname=true
-Djclouds.provider=s3
Thanks!
-Original Message-
From: Yao, Julie
Sent: Sunday, January 31, 2016 10:01 AM
To: Andrew Phillips; user@jclouds.apache.org
Subject: RE: Use JClouds to talk to non AWS
Hm...not much difference there:
s3curl call that succeeds:
HEAD /public HTTP/1.1
User-Agent: curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5
OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
Host: jag-itop-svr.dev.opsware.com:8080
Accept: */*
Date: Sun, 31 Jan 2016 17:54:30 +
Authorization: AWS
Found the solution. If I execute commands in a single line using &&,
written as a java string they work as expected.
Uff. Glad to hear you were able to get it to work in the end!
ap
but the result is wrong.
Ah, pity :-( Caught celebrating too soon ;-) One of the things that may
be worth trying here is to move away from the portably blobstore
abstraction and try the API directly - that's more comparable to the
boto calls.
...
S3Client client =
I guess
overrides.setProperty(PROPERTY_S3_SERVICE_PATH, "/services/Walrus");
is not correct.
Without it, it will throw exception.
Ah, OK. To confirm: are we calling a Walrus installation here?
Also, in your boto code snippet:
def connect(self):
self.connection = boto.connect_s3 (
Thanks for the heads-up, Julie - glad you were able to get it to work!
ap
Hi Wesley
I'm starting studies with Apache jclouds. So, I plan to collect data
from the vcpu and memory each instance of an OpenStack cloud. The
example "CloudWatch-basics" available on GitHub can be used to
OpenStack clouds? It seems that can only be used for EC2 clouds.
The CloudWatch
Hi Forrest
Here is the code I used to generate results file,
http://pastebin.com/x85yHTHW
Looking at the code snippet, it doesn't seem like we're actually making
an ACL call with boto. Could you see what happens if you add that?
Hi Forrest
Thanks for getting in touch! Could you share the part of the code where
you're creating the jclouds context in a Gist or Pastie?
And just to clarify: you're trying to connect to an *OpenStack*
instance, but using the S3 API?
Regards
ap
[1] http://pastie.org
Hi Forrest
Thanks for the update!
Where it looks like I fail is when I am doing a GET
request on this, http://:8080/?acl, more
than once and eventually getting an Internal Server Error --
2015-12-02 17:06:31.095 DEBUG [Thread-12] j.headers >> GET
Could this be related to the fact that I'm using the 's3'
builder versus the 'aws-s3'?
Intuitively, that seems unlikely: if anything, I'd expect calls made
using the aws-s3 provider to be *more* AWS-specific than the more
generic S3 API.
What we'd ideally like to find out is how the boto
Hi Subhadip
Looking at the tests (e.g. [1]), it would certainly seem as though the
provider expects to be able to support the local disk type.
Could you enable wire and header logging [2] to see what the request
that is actually being made to SoftLayer looks like, and post it to a
Gist or
After upgrading to 1.9.1 it's starts happening. Any idea ?
What was the previous version you were using? Were there any other
changes you made to your setup, e.g. the JVM type of version?
This is not something we've had anyone else report so far, so at this
point it seems more likely to be
But strangely the program execution is not coming out of the
main thread called. After connecting to the node is it trying to
fetch something which never completes?
If you take a thread dump or look at it using VisualVM or so, can you
see where it's hanging? Also, have you tried enabling wire
Correct. I dont want to connect to the node on creation. Will
make a separate call for bootstrap to connect and deploy
scripts. Is there any way to disable the connect to node ?
You might want to see if setting "blockUntilRunning" to false in the
TemplateOptions [1] makes any difference. It's
[moving this to user@...]
What is the correct procedure to pass certificate for every public
clouds through jclouds? if I have to ship the application to any
remote machine ?
In terms of trusting certificates, jclouds doesn't behave any
differently than any other Java application. The first
My doubt is why the request is trying to do ssh while node
creation. I'm not doing any runScript on the node in my
computeService request.
Ah, thanks for clarifying - I had misunderstood your question. From what
I recall, the SSH check is try to verify that the node is actually
accessible and
[responding on user@]
I'm supplying actual proxy ip and port with username and password,
Ah, OK, thanks for clarifying. Does your proxy allow port 22? From the
following message, I suspect that it might be blocking that port:
WARNING: Error checking reachability of ip:port 146.148.11.83:22
I really appreciate it.
Hey, we're not done yet (or is it all working now?) ;-) But glad to hear
this is helping...
Regards
ap
error: group(class java.lang.NullPointerException)
An NPE, eh? I see that the code seems to have changed relative to the
current trunk - do you think you could build against 2.0.0-SNAPSHOT and
run the example again to see if anything's changed?
I've pasted a version of the compute-basics
Hi Jonathan
If you built the examples from source, could you modify the error
handling line in [1] to also print out the type of the exception and the
stacktrace? E.g. from:
} catch (Exception e) {
System.err.println(error: + e.getMessage());
error = 1;
} finally {
to
} catch
I installed jclouds1.9.0 and was trying out the
JCloudsNovajava example from docs and I get an error
while compiling the code. I have copied the pom.xml from
the doc and tried to compile it.. The error is
How are you setting up this project? What libraries are on your
classpath?
Regards
ap
Hi Mark
How does jClouds cope with https endpoints. Do I have to set up
anything in the client to make a https connection?
Are you getting any specific error? If so, could you share the full
stack trace or error message?
Regards
ap
(java.lang.Iterable)
--
Andrew Phillips
Apache jclouds
context-scoped) etc, so in general, I'd say you try to create a
context just once and reuse it when possible, and configure the thread
pool size to fit your app needs.
See also this old thread:
https://groups.google.com/forum/#!topic/jclouds/pF9ZqXPdLTk
Regards
ap
Well, I was able to update assembly/pom.xml to use a local copy
jclouds-karaf features.xml file. Indeed, maven downloaded the jar, I can
see it in the final packaging now:
./system/com/jcraft/jsch.agentproxy.usocket-jna/0.0.8/jsch.agentproxy.usocket-jna-0.0.8.jar.
However, the
./system/com/jcraft/jsch.agentproxy.usocket-jna/0.0.8/jsch.agentproxy.usocket-jna-0.0.8.jar.
However, the NoClassDefFoundError is still persisting.
Dang. Hm, in that case I suspect this will require some more
investigation, and unfortunately I don't have any cycles to look into
this
Hi Liang
Is this behaviour reproducible, i.e. does it happen every time you run
the example? If you add some wait time to the example code between the
moment it destroys the node and tries to delete the security group, do
you get the same result?
Regards
ap
Do we know if anyone will be working one this anytime soon?
https://github.com/jclouds/jclouds/pull/605 is being reviewed right now ;-)
Thanks for the ping!
ap
Hi Eyal
Could you enable wire and header logging [1] and then try to replicate
this by trying the same request through the proxy that the jclouds is
trying to make? Or is that what you tested already?
Also, are you using any of the jclouds HTTP drivers (okhttp or
apachehc), or are you
So here instanceType.T2_MICRO not supported. Only previous generation
listed here.
jclouds indeed supports only those instance types listed in the
InstanceType [1] enum. Please raise a JIRA or open a pull request for
any types that are missing.
Thanks for raising this!
ap
[1]
Hi Yaron
To create nodes in a subnet under Amazon VPC add the following option to
your template options. Note that VPCs and Security Groups are mutually
exclusive.
Why?
From what I understand, Security Groups here refers to the
classic security groups that are referred to as EC2-Classic in
Is this because of incorrect Manifest file in the 1.8.1 jar that I have
reported in another thread[1]? Or what would be issue here?
I would assume that, if this were related to incorrect import package
statements, you wouldn't be able to load the bundle in the first
place. But that's just a
Is there a way to force the headers for these 401 responses to be logged?
I'm afraid I can't help with that, but does making the request that
jclouds makes via cURL actually cause a 401, or does it succeed when
not going via jclouds?
Regards
ap
The Apache jclouds team is pleased to announce the release of jclouds 1.8.1.
Apache jclouds is an open source multi-cloud toolkit for the Java
platform that gives you the freedom to create applications that are
portable across clouds while giving you full control to use
cloud-specific
Hi Duncan
Thanks for bringing this up! Sorry for the delay in responding - 1.8.1
has been eating up some time of late ;-)
Please chip in and maybe copy users on the dev discussion on this
particular topic.
One related topic that has recently been discussed on the dev list [1]
is the
rraju1...@gmail.com -
Date: Fri, 17 Oct 2014 18:20:22 +0530
From: Rajaratnam Rajkumar rraju1...@gmail.com
Reply-To: Rajaratnam Rajkumar rraju1...@gmail.com
Subject: Re: How to destroy an instance without node id?
To: Andrew Phillips andr...@apache.org
Hi Andrew,
Set? extends
.
--
Andrew Phillips
Apache jclouds
I am using EC2. Most of the time it works fine. But sometimes node id null.
Do you currently have a node in EC2 that exhibits this behaviour, or
is this relatively frequent? Could you send a screenshot of what the
EC2 console shows for a node like this?
Regards
ap
Forwarding to user@...
Hi Jeffrey
Does jClouds support IPv6?
Just to clarify: do you mean does the jclouds openstack-nova API
support servers with only IPv6 addresses?, or something related to
IPv6 support more generally?
Could you describe what you are trying to do?
Thanks!
ap
Thanks Andrew, at the reflection jar there is another guava.jar. So I
excluded it:
Do things work now? ;-)
ap
Hi Aric
Anyone here using google-compute-engine provider for jclouds there appears
to be a problem when putting the pem extracted from the .p12 into the
credential section of my jenkins config.xml
Could you first see if you can run the basic example [1] directly
against GCE with the same
So, any ideas about what could be the problem? Is jclouds compatible
with the Android platform?
On this specific point, which seems to be related to the way jclouds
is trying to use ServiceLoader to load the appropriate implementation
class for an API or provider:
java.util.NoSuchElementException: key [aws-ec2] not in the list of
providers or
apis: {}
at org.jclouds.ContextBuilder.newBuilder(ContextBuilder.java:174)
Seems to be a classpath issue? Any hints?
The problem here is most likely related to ServiceLoader: jclouds uses
a META-INF/...
is a method in jclouds ec2 api. So can some one point out me a method or
another way for get all configured regions in cloudstack?
Are you talking about these kind of regions [1]? Could you link to the
actual CloudStack API call that you would make to retrieve the
information you're looking
This sounds like an http transport concern, Yury.
Perhaps you can try a different driver, such as our okhttp one?
On this point: which driver are you currently using? The default
(standard Java HTTP) one? As Adrian mentions, trying the OkHttp or
Apache HC alternatives [1], [2] sounds like
i want for version 2.0.0..
jclouds version 2.0.0 has not been released yet - the latest version is 1.8.0:
http://jclouds.apache.org/releasenotes/
ap
Is there any way to stop an instance using jclouds? In ComputeService
interface there is no such a method. There is a method for destroy an
instance. But I want to an instance.
Stopping instances is not currently supported at the view level, i.e.
in ComputeService. But for those APIs and
although I'm not entirely sure what the difference is between the AWSS3Client
the docs are using, and the S3Client that I've used
One is the API-specific client, the other the provider-specific client
(see [1]). I.e. S3Client should work with all S3-compatible
providers, whereas the
was apparently removed in Jclouds 1.6. I think I can work around this using
contextBuilder.buildApi(S3Client.class) and the S3Object class to set the
ACL.
But then if I have to use an S3-specific API to set an ACL, why not just
use the com.amazonaws.services.s3.AmazonS3Client client directly?
Hi Asanka
I think what Schalk was trying to point out is that's its generally
advised never to put sensitive information such as your passwords into
an email on a public forum such as this one. If I understand
correctly, your CloudStack instance is running locally, so hopefully
is not
I have all the required jars. As I said in Eclipse it's working fine,
the problem comes from the command line.
How are you running the program from the command line?
ap
With the most recent code (master) I am running into other issues. (Pls
Note, I initially tried to update my maven to version 2.0.0 and that still
had the the globalIdentifier problem).
2.0.0 does not exist (yet). I take it you mean 2.0.0-SNAPSHOT [1]?
ap
[1]
Can any of the devs respond to this issue?
jclouds uses Guava pretty heavily, including some of the newer
features that were added in more recent releases (Andrew G can
probably provide much more technical detail here). In some instances,
such as fixing JCLOUDS-427 [1], we actually
fixed delay between the 2,3,4th attempts. Is there a way to
configure an increasing backoff?
According to its Javadoc, [1] BackoffLimitedRetryHandler already
provides an exponential backoff. Is that the kind of thing you're
looking for?
Glad to hear the re-authentication is working, at
is there a plan to change it? was it forgotten?
The plan is still to de-async all APIs, including Keystone. If you
are using the Keystone API, please use the sync interface if possible.
Do you need to use the async interfaces in your code in any specific
situations?
ap
Is there any reason it wasn't moved? Maybe the retryOnRenew or is there no
prevention to de-async it?
As far as I am aware, it's simply still work in progress. The goal
was to be working on de-asyncing for 2.0...
ap
After some more experimenting I found out how it works.
Thanks for the details, David - glad to hear it's working!
ap
org.jclouds.blobstore.LocalAsyncBlobStore.putBlob(LocalAsyncBlobStore.java:405)
The error is in putBlob, which actually tries to write the blob to the
target location, but may also write to the temporary directory.
Which drive on your system actually has no space left any more? And
what
How could I delete the files only the temporary directory? I also cant find
this directory at /tmp
All I can see in your stacktrace is:
java.lang.RuntimeException: java.io.IOException: No space left on device
It does not say *which* device is out of space. Could you check on
your target
Moving this to user@...
I am not sure how to get ObjectID for Swift Object. Earlier I have worked
with SNIA CDMI object storage. Where we can access an Object using its name
or unique ObjectID.
Both the portable BlobStore API [1] and the Swift-specific ObjectApi
[2] support blob retrieval
I've done some google searches and haven't found much information on
this -- is there a standard way (or automatic within jclouds) to
perform re-authentication when the token expires?
Which provider are you talking about specifically? There a quite a few
APIs in jclouds the try to renew
can you please explain why I am getting this error. I downloaded all
required jars.
Could you put the code you're using and the exact stacktrace you're
getting into a Gist or Pastie [1]?
Regards
ap
[1] http://jclouds.apache.org/reference/report-a-bug/
Of course, the proper fix is to make sure the DNS validator is not
used when cleaning up key pairs...
Should an error during a cleanup process like this lead to the
exception being caught and logged, rather than being propagated to the
user?
ap
How would I pass in my new context module?
That would be a good question to ask on #IRC [1], I think.
Basically, as far as I recall (don't quote me on this! ;-)), you'll
have to create your own ApiMetadata, probably by overriding
S3ApiMetadata [2], and change the set of default modules.
Usually I would not recommend using different versions of the
dependencies. However, I don't recall any particular reasons they
might conflict.
Definitely would like to repeat that it's not recommended to mix
different versions of jclouds JARs in your app. But of course, we can
always
blobStore.putBlob(), the S3 provider requests the bucket's ACL first. From
looking at the code, it appears that the ACLs should be cached after the
first GET, but I'm not seeing that.
Could you point out which code (path) specifically you're looking at here?
Thanks!
ap
2 - I use this implementation of iSCSI http://jscsi.org/. And it is this
class that saves my blobs
http://grepcode.com/file/repo1.maven.org/maven2/org.jscsi/target/2.5.2/org/jscsi/target/storage/JCloudsStorageModule.java?av=f
As far as I can see, the questions you have are related to jSCSI,
yes. But What I am doing is editing jscsi code. So they don't know how to
answer because they don't move the blobs to other place.
Ah, OK. Still, the specific details of how a blob is stored are either
jSCSI-specific, or (as Andrew Gaul pointed out) specific to the native
filesystem
Latest jclouds-examples can build under 1.8.0. With jclouds 2.0, I see the
errors below:
Since jclouds 2.0.0 does not exist yet, you will not be able to use
that version. Please use 1.8.0 instead.
ap
Hi Filipe
I am new with jclouds. What I am doing is: Opening a disk with java and
formatting it with jclouds. So, instead of write Files.write() I use
jclouds.
Which provider or API are you using? And which underlying system (a
file system, I suspect?) are you talking to?
Which commands
1 - 100 of 179 matches
Mail list logo