Re: [Micronet] MATLAB Distributed Computing on Amazon EC2; licensing

[Greg MERRITT]

Thank you, Kerry.

Matlab user community: If you're interested, pipe up! :)

-Greg

On Tue, Feb 16, 2016 at 3:47 PM, Kerry Hays <kh...@berkeley.edu> wrote:

> Hi Greg,
>
> Thank you for expressing your interest in this service.  MDCS is not
> currently part of our campus Matlab licensing agreement, however if there
> is enough interest from the Matlab user community we would be happy to
> explore options for adding it to the agreement.
>
> Thank you,
>
> Kerry
> IS Software Licensing and Distribution
>
>
> On 2/12/2016 12:41 PM, Greg MERRITT wrote:
>
> Micronet,
>
> We're interested in a new service called MATLAB Distributed Computing
> Server for Amazon EC2:
>
>
> <https://www.mathworks.com/products/parallel-computing/parallel-computing-on-the-cloud/distriben-ec2.html>
> https://www.mathworks.com/products/parallel-computing/parallel-computing-on-the-cloud/distriben-ec2.html
>
>
> This service appears to be in an "early adopter" phase. We registered for
> access about a week ago, but haven't received any response from Mathworks
> yet.
>
> Do any of you have any experience with this new service? Any chance that
> our campus MATLAB licensing applies for this kind of use?
>
> Thanks!
>
> -Greg
>
>
>
> -
> The following was automatically added to this message by the list server:
>
> To learn more about Micronet, including how to subscribe to or unsubscribe 
> from its mailing list and how to find out about upcoming meetings, please 
> visit the Micronet Web site:
> http://micronet.berkeley.edu
>
> Messages you send to this mailing list are public and world-viewable, and the 
> list's archives can be browsed and searched on the Internet.  This means 
> these messages can be viewed by (among others) your bosses, prospective 
> employers, and people who have known you in the past.
>
> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
> micronet-annou...@lists.berkeley.edu list.
>
>
>
>
> -
> The following was automatically added to this message by the list server:
>
> To learn more about Micronet, including how to subscribe to or unsubscribe
> from its mailing list and how to find out about upcoming meetings, please
> visit the Micronet Web site:
>
> http://micronet.berkeley.edu
>
> Messages you send to this mailing list are public and world-viewable, and
> the list's archives can be browsed and searched on the Internet.  This
> means these messages can be viewed by (among others) your bosses,
> prospective employers, and people who have known you in the past.
>
> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the
> micronet-annou...@lists.berkeley.edu list.
>
>
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

[Micronet] UCB AWS Direct Connect route propagation down for others?

[Greg MERRITT]

Hi all,

I've opened a ticket...but I'm wondering if any other UCB AWS Direct
Connect users saw their DC go down as of the last hour or so, due to lack
of propagation of route tables?

Thanks!

-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] UCB AWS Direct Connect route propagation down for others?

[Greg MERRITT]

Thanks!

Looks like that just showed up about fifteen minutes ago. Whew, thought I
was crazy -- I swear I looked there first! :)

-Greg

Le mercredi 10 février 2016, Steve Dalton <sdal...@berkeley.edu> a écrit :

> Just saw this come across from systemstatus.berkeley.edu
>
> *NEW POSTING:*
> Unscheduled Outage AWS DirectConnect
> <http://ucbsystems.org/category/active/unscheduled-outage/>
>
> *Outage Type:* UNSCHEDULED OUTAGE
> *Date Submitted*: Wednesday, February 10, 2016
> *Outage Start/End Time*: 1112 – TBD
> *Groups Impacted*: AWS DirectConnect Users
> *Equipment*: Provider Network
>
> *Description*: An outage in the Pacific Wave backbone is causing a loss
> of connectivity for the Berkeley DirectConnect link to Amazon Web Services.
>
> No ETA is available at this time.
>
> Please direct any questions you may have regarding this announcement to:
> Erik McCroskey
>
> *CMR*: 4388
>
> *Steve Dalton*
>
> System Administrator 2
>
> Vice Chancellor Real Estate IT Department - University of California,
> Berkeley
>
> *Please consider the environment before printing this email*
>
> On Wed, Feb 10, 2016 at 12:54 PM, Greg MERRITT <gmerr...@berkeley.edu
> <javascript:_e(%7B%7D,'cvml','gmerr...@berkeley.edu');>> wrote:
>
>> Hi all,
>>
>> I've opened a ticket...but I'm wondering if any other UCB AWS Direct
>> Connect users saw their DC go down as of the last hour or so, due to lack
>> of propagation of route tables?
>>
>> Thanks!
>>
>> -Greg
>>
>>
>> -
>> The following was automatically added to this message by the list server:
>>
>> To learn more about Micronet, including how to subscribe to or
>> unsubscribe from its mailing list and how to find out about upcoming
>> meetings, please visit the Micronet Web site:
>>
>> http://micronet.berkeley.edu
>>
>> Messages you send to this mailing list are public and world-viewable, and
>> the list's archives can be browsed and searched on the Internet.  This
>> means these messages can be viewed by (among others) your bosses,
>> prospective employers, and people who have known you in the past.
>>
>> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the
>> micronet-annou...@lists.berkeley.edu
>> <javascript:_e(%7B%7D,'cvml','micronet-annou...@lists.berkeley.edu');>
>> list.
>>
>>
>
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] UCB AWS Direct Connect route propagation down for others?

[Greg MERRITT]

In case this is jamming up anyone else, I found an awesome / terrible
workarounda quickie EC2 instance running a VPNthis happens to be a
proxy for traffic to the entire Internet AND to the private AWS
subnet.even though there is authentication, it's pretty
nervous-makingAND the quickie client setup for the desktop has you
route ALL traffic through the VPNwhich could make for bad traffic bills
($$$) from AWS if it got out of hand.

...but, if anyone else is also up this creek, drop me a line and I'll send
linksno indications of outage duration, so it's one of the candidates
on the table for whatever our Plan B will be tomorrow*gulp*fingers
crossed!

-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] docker-machine vs. UCB AWS Direct Connect

[Greg MERRITT]

Thanks to everyone for the considered replies, both on- and off-list!

Folks tossed out a number of creative ideas for wiring things up a little
differently, kind of outside of the Docker tools. At one extreme, one could
do Docker deployment differently -- in effect, doing lots of the bits by
hand, whether with managing the containers & their deployment, making
explicit changes to network config, and so on.

At the other extreme would be a solution that supported the promise of
these tools (like docker-machine & docker-compose), namely, that they take
care of all of this stuff so that you never have to think about it. ;)

Maybe the ultimate solution is something like a fix to docker-machine that
lets it understand the Direct Connect / RFC1918 context, perhaps via a flag
when invoked, or something similar.

A lot to chew on...I will digest...

Thanks!

-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

[Micronet] docker-machine vs. UCB AWS Direct Connect

[Greg MERRITT]

Dear Cloudy Micronetters,

I've hit a nasty catch-22 using docker-machine to set up an AWS EC2 that
has a private UCB Direct Connect address. It goes something like this:

The EC2 requires a route to the public internet so you'll be able to do
apt-get (and other from-the-Internet downloads) to build out Docker
containers.

Meanwhile, AWS EC2 network interfaces on a UCB RFC1918 Direct Connect VPC
are given routing tables that (appropriately) only reference campus network
ranges, and do not support routing out to the public Internet through
campus.

So, how to let your UCB RFC1918-addressed EC2 find the Internet? The most
handy way is to also give it a public IP address, which comes with "igw"
(Internet gateway) routing.(*) BAM! The EC2 has a pathway to the Internet.

Now, when your EC2 comes up, docker-machine tries to do log in to the EC2
to do its magic. It says, "Hey, EC2 API! What's the IP address of my shiny
new EC2 instance?" When it does that, it learns the EC2's *public* IP
address, and it then tries to ssh into the EC2 through that public IP
address so that it can continue setup of the shiny new EC2 instance.

Now, if you're doing all of this from campus, then your local desktop (from
which you're running docker-machine) awaits a response from the EC2 *from* the
EC2's public interface. But guess what? Your local campus desktop is on
campus...and the EC2's routing tables tell it to answer your desktop's ssh
conversation via its UCB RFC1918-addressed 10.x.x.x Direct Connect
interface.

So...your desktop's docker-machine ssh gets a response from some strange,
other IP, and it never completes the conversation.

*Another way of saying it: docker-machine knocks on the front door of the
EC2, but the EC2 answers at the back door...leaving docker-machine hangin'
out in the cold on the front porch.*

By the way: if I do *not* let the EC2 have a public IP address -- it only
has a back door, so to speak -- then  docker-machine
can ssh just fine! Bummer is that when the setup continues, there is no
pathway to the Internet to do apt-get and all the other juicy setup stuff.

...and, in a freaky twist, I can run docker-machine from off campus to fire
up such an EC2 with a UCB RFC1918-addressed 10.x.x.x Direct Connect, and it
all comes up great, since the campus RFC1918 Direct Connect interface is
never involved in the setup conversations. Go figure. Unfortunately,
there's no way to readily mange this EC2 from campus after it's up...the
ssh key generated by the docker-machine setup process is only good for the
public interface, so you have the same front door / back door problem.

Any nice workarounds for this...?

Thanks!

-Greg

(*) A less-handy way would be to fire up an AWS NAT service instance for
your EC2's subnet...and that may actually be the realistic
solution...but!
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

[Micronet] Monday^WTuesday morning chuckle...

[Greg MERRITT]

You never can be too careful with spam! ;)

[image: Inline image 1]


-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

[Micronet] iMac suction cups for loan?

[Greg MERRITT]

Micronetters,

My desktop iMac's internal drive is giving SMART errors. Does anyone on
campus have suction cups (and maybe the HD Torx wrenches...) I could borrow
for yanking off its glass front?

Thanks!!

-Greg


-- 
Envoyé avec Gmail Mobile
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] FileMaker 14 Server Hardware

[Greg MERRITT]

Hi James,

To toss out another option:

Through a combination of particular (and peculiar) circumstances, our group
has developed a severe allergy to hardware. It's so bad that we fear it's
contagious. ;)  Basically, we can focus loads more on what we do best, and
never spend effort, time, & money on the care & feeding of hardware.

There's a bit of a learning curve, but I don't think we're ever going back.
Some quick Googling...

http://google.com/search?q=filemaker+aws


...suggests that you could fire up a Windows instance in AWS and go full
speed ahead with a FM installation. I suspect it's quite doable in Azure &
Google, too.

Well, something to consider...once you make the jump, you'll never have to
negotiate a hardware purchase / server replacement again! 

-Greg



On Fri, Dec 4, 2015 at 3:49 PM, James Hixon  wrote:

> Greetings Micronet,
>
> My department is upgrading our FileMaker 11 Server to FileMaker 14 and
> considering whether to replace our hardware with a 2014 Mac Mini or a
> Dell/Lenovo Windows 2012 Server.
>
> Although the most recent Mac Minis are not server-grade and do not
> technically meet FM 14 Server's recommended specs, I tend to think it would
> be ok for our volume of users/transactions (about 25 databases, about 15
> users, no WebDirect). However, I'm compelled by the robustness,
> flexibility, and upgradeability that the less expensive Windows options
> offer.
>
> I'm wondering if anyone can speak to their experience hosting FileMaker 14
> databases on a 2014 i5 or i7 dual-core Mac Mini.
>
> I'm also curious about the additional setup and maintenance required to
> keep a Windows server in compliance with campus security requirements.
>
> If you have any thoughts, warnings, or suggestions, please send them my
> way!
>
> Thanks,
>
> James Hixon
> Database Administrator
> Graduate School of Education
> jnhi...@berkeley.edu
> 510-642-5031
>
>
>
> -
> The following was automatically added to this message by the list server:
>
> To learn more about Micronet, including how to subscribe to or unsubscribe
> from its mailing list and how to find out about upcoming meetings, please
> visit the Micronet Web site:
>
> http://micronet.berkeley.edu
>
> Messages you send to this mailing list are public and world-viewable, and
> the list's archives can be browsed and searched on the Internet.  This
> means these messages can be viewed by (among others) your bosses,
> prospective employers, and people who have known you in the past.
>
> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the
> micronet-annou...@lists.berkeley.edu list.
>
>
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

As an aside -- while unlikely and uncommon, my group's research nature
means that there can sometimes be hiccups in funding...so, for us,
subsidized solutions like bDrive and Box have a strong appeal to us along
the business continuity axis!

-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

Ooh, no! I'll check it out. This may indeed be helpful after we get the
historical backlog up there.

Thanks!

-Greg

On Mon, Oct 5, 2015 at 4:40 PM, Michael Chung <mch...@haas.berkeley.edu>
wrote:

> Hi Greg,
>
> Have you checked this out?
>
> http://www.duplicati.com/
>
> Full disclaimer, I haven't used it myself, but it appears you can run
> incremental transfers, which should at least give you "rsync"-like
> functionality after an initial Full backup.
>
> Thanks,
>
> *Michael Chung*
> Systems Administrator
> Enterprise Computing & Service Management
> Haas School of Business, UC Berkeley
> Student Services Building, Room S300D
> Berkeley, CA 94720-1900
> Tele: 510-643-3887
>
> Typical Office Schedule
> Offsite: M-F
> At Haas: On-demand
>
> On Mon, Oct 5, 2015 at 4:23 PM, Greg Merritt <gmerr...@berkeley.edu>
> wrote:
>
>> Hello Micronet,
>>
>> We'd love to use our SPA bDrive as an archive location for a infrequently
>> and selectively accessed Bag of Holding for data sets of millions of small,
>> individual, already-compressed ~10K files.
>>
>> Folder drag & drop into the bDrive browser interface on Mac Chrome leads
>> to unhappiness, as the browser crashes after a while.
>>
>> Rather than tar-ing them, or dragging them over in subgroups, is there a
>> more direct way to send over the lot? We'd rather not do the desktop
>> synching with these, unless there's a super-elegant way to use that
>> mechanism.
>>
>> (Would *really* love to do an additive rsync here in the long run, but
>> I'm probably just dreaming here.)
>>
>> Thanks for any tips!
>>
>> -Greg
>>
>>
>> -
>> The following was automatically added to this message by the list server:
>>
>> To learn more about Micronet, including how to subscribe to or
>> unsubscribe from its mailing list and how to find out about upcoming
>> meetings, please visit the Micronet Web site:
>>
>> http://micronet.berkeley.edu
>>
>> Messages you send to this mailing list are public and world-viewable, and
>> the list's archives can be browsed and searched on the Internet.  This
>> means these messages can be viewed by (among others) your bosses,
>> prospective employers, and people who have known you in the past.
>>
>> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the
>> micronet-annou...@lists.berkeley.edu list.
>>
>>
>
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

Interesting.

Oh! I see that Box accounts now have unlimited capacity, too, yeah? (Guess
I'd missed that.)

Thanks, I'll take a look! If you have documentation handy, do please toss
my way. (This isn't super-duper time criticalwell, until another hard
drive dies..)

Thanks!

-Greg

On Mon, Oct 5, 2015 at 4:46 PM, Christopher R. HOFFMAN <chri...@berkeley.edu
> wrote:

> Hi Greg, we have also seen people use the Box API to script file
> synchronization. I am not sure where that documentation is right now let me
> know if that is an option.
> Chris
>
> On Oct 5, 2015, at 4:43 PM, Greg Merritt <gmerr...@berkeley.edu> wrote:
>
> Ooh, no! I'll check it out. This may indeed be helpful after we get the
> historical backlog up there.
>
> Thanks!
>
> -Greg
>
> On Mon, Oct 5, 2015 at 4:40 PM, Michael Chung <mch...@haas.berkeley.edu>
> wrote:
>
>> Hi Greg,
>>
>> Have you checked this out?
>>
>> http://www.duplicati.com/
>>
>> Full disclaimer, I haven't used it myself, but it appears you can run
>> incremental transfers, which should at least give you "rsync"-like
>> functionality after an initial Full backup.
>>
>> Thanks,
>>
>> *Michael Chung*
>> Systems Administrator
>> Enterprise Computing & Service Management
>> Haas School of Business, UC Berkeley
>> Student Services Building, Room S300D
>> Berkeley, CA 94720-1900
>> Tele: 510-643-3887
>>
>> Typical Office Schedule
>> Offsite: M-F
>> At Haas: On-demand
>>
>> On Mon, Oct 5, 2015 at 4:23 PM, Greg Merritt <gmerr...@berkeley.edu>
>> wrote:
>>
>>> Hello Micronet,
>>>
>>> We'd love to use our SPA bDrive as an archive location for a
>>> infrequently and selectively accessed Bag of Holding for data sets of
>>> millions of small, individual, already-compressed ~10K files.
>>>
>>> Folder drag & drop into the bDrive browser interface on Mac Chrome leads
>>> to unhappiness, as the browser crashes after a while.
>>>
>>> Rather than tar-ing them, or dragging them over in subgroups, is there a
>>> more direct way to send over the lot? We'd rather not do the desktop
>>> synching with these, unless there's a super-elegant way to use that
>>> mechanism.
>>>
>>> (Would *really* love to do an additive rsync here in the long run, but
>>> I'm probably just dreaming here.)
>>>
>>> Thanks for any tips!
>>>
>>> -Greg
>>>
>>>
>>> -
>>> The following was automatically added to this message by the list server:
>>>
>>> To learn more about Micronet, including how to subscribe to or
>>> unsubscribe from its mailing list and how to find out about upcoming
>>> meetings, please visit the Micronet Web site:
>>>
>>> http://micronet.berkeley.edu
>>>
>>> Messages you send to this mailing list are public and world-viewable,
>>> and the list's archives can be browsed and searched on the Internet.  This
>>> means these messages can be viewed by (among others) your bosses,
>>> prospective employers, and people who have known you in the past.
>>>
>>> ANNOUNCEMENTS: To send announcements to the Micronet list, please use
>>> the micronet-annou...@lists.berkeley.edu list.
>>>
>>>
>>
>
> -
> The following was automatically added to this message by the list server:
>
> To learn more about Micronet, including how to subscribe to or unsubscribe
> from its mailing list and how to find out about upcoming meetings, please
> visit the Micronet Web site:
>
> http://micronet.berkeley.edu
>
> Messages you send to this mailing list are public and world-viewable, and
> the list's archives can be browsed and searched on the Internet.  This
> means these messages can be viewed by (among others) your bosses,
> prospective employers, and people who have known you in the past.
>
> ANNOUNCEMENTS: To send announcements to the Micronet list, please use the
> micronet-annou...@lists.berkeley.edu list.
>
>
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

Re: [Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

Too much data to stick in a local gDrive folder, really...want to have no
local long-term archive on a random desktop, if you digmaybe for a
one-time initial backfill, but then would want to purge from
localhmmm.

Thanks for the tip on the sync index size!

-Greg

On Mon, Oct 5, 2015 at 4:54 PM, Richard DESHONG <rdesh...@berkeley.edu>
wrote:

> Hi Greg,
> It seems like Google Drive is exactly what you want.  Install it, move all
> your files into the folder, and GD will churn away in the background
> uploading all of the files.  Moving forward, just drop new files in, and GD
> will sync those.
>
> I have, in the past, seen forum issues with the sync index size - that is,
> when the file count gets too large, the sync process fails.  So you'd need
> to research that first.
>
> On Mon, Oct 5, 2015 at 4:43 PM, Greg Merritt <gmerr...@berkeley.edu>
> wrote:
>
>> Ooh, no! I'll check it out. This may indeed be helpful after we get the
>> historical backlog up there.
>>
>> Thanks!
>>
>> -Greg
>>
>> On Mon, Oct 5, 2015 at 4:40 PM, Michael Chung <mch...@haas.berkeley.edu>
>> wrote:
>>
>>> Hi Greg,
>>>
>>> Have you checked this out?
>>>
>>> http://www.duplicati.com/
>>>
>>> Full disclaimer, I haven't used it myself, but it appears you can run
>>> incremental transfers, which should at least give you "rsync"-like
>>> functionality after an initial Full backup.
>>>
>>> Thanks,
>>>
>>> *Michael Chung*
>>> Systems Administrator
>>> Enterprise Computing & Service Management
>>> Haas School of Business, UC Berkeley
>>> Student Services Building, Room S300D
>>> Berkeley, CA 94720-1900
>>> Tele: 510-643-3887
>>>
>>> Typical Office Schedule
>>> Offsite: M-F
>>> At Haas: On-demand
>>>
>>> On Mon, Oct 5, 2015 at 4:23 PM, Greg Merritt <gmerr...@berkeley.edu>
>>> wrote:
>>>
>>>> Hello Micronet,
>>>>
>>>> We'd love to use our SPA bDrive as an archive location for a
>>>> infrequently and selectively accessed Bag of Holding for data sets of
>>>> millions of small, individual, already-compressed ~10K files.
>>>>
>>>> Folder drag & drop into the bDrive browser interface on Mac Chrome
>>>> leads to unhappiness, as the browser crashes after a while.
>>>>
>>>> Rather than tar-ing them, or dragging them over in subgroups, is there
>>>> a more direct way to send over the lot? We'd rather not do the desktop
>>>> synching with these, unless there's a super-elegant way to use that
>>>> mechanism.
>>>>
>>>> (Would *really* love to do an additive rsync here in the long run, but
>>>> I'm probably just dreaming here.)
>>>>
>>>> Thanks for any tips!
>>>>
>>>> -Greg
>>>>
>>>>
>>>>
>>>> -
>>>> The following was automatically added to this message by the list
>>>> server:
>>>>
>>>> To learn more about Micronet, including how to subscribe to or
>>>> unsubscribe from its mailing list and how to find out about upcoming
>>>> meetings, please visit the Micronet Web site:
>>>>
>>>> http://micronet.berkeley.edu
>>>>
>>>> Messages you send to this mailing list are public and world-viewable,
>>>> and the list's archives can be browsed and searched on the Internet.  This
>>>> means these messages can be viewed by (among others) your bosses,
>>>> prospective employers, and people who have known you in the past.
>>>>
>>>> ANNOUNCEMENTS: To send announcements to the Micronet list, please use
>>>> the micronet-annou...@lists.berkeley.edu list.
>>>>
>>>>
>>>
>>
>>
>> -
>> The following was automatically added to this message by the list server:
>>
>> To learn more about Micronet, including how to subscribe to or
>> unsubscribe from its mailing list and how to find out about upcoming
>> meetings, please visit the Micronet Web site:
>>
>> http://micronet.berkeley.edu
>>
>> Messages you send to this mailing list are public and world-viewable, and
>> the list's archives can be browsed and searched on the Internet.  This
>> means these messages can be v

[Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

Hello Micronet,

We'd love to use our SPA bDrive as an archive location for a infrequently
and selectively accessed Bag of Holding for data sets of millions of small,
individual, already-compressed ~10K files.

Folder drag & drop into the bDrive browser interface on Mac Chrome leads to
unhappiness, as the browser crashes after a while.

Rather than tar-ing them, or dragging them over in subgroups, is there a
more direct way to send over the lot? We'd rather not do the desktop
synching with these, unless there's a super-elegant way to use that
mechanism.

(Would *really* love to do an additive rsync here in the long run, but I'm
probably just dreaming here.)

Thanks for any tips!

-Greg
 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

ANNOUNCEMENTS: To send announcements to the Micronet list, please use the 
micronet-annou...@lists.berkeley.edu list.

[Micronet] SPA bDrive for large archive of small data files

[Greg Merritt]

Definitely no need to apologize -- I really haven't explained very well.

We have some real-world data feeds that work on slightly different
timescales -- some are daily reports, archived for a relatively long time
remotely (but copied to campus daily), some are updated & polled every
minute, and cache for a few days remotely, while another can be polled
every minute or so, but only "current" data is ever available.

On our side, it is very useful to have deep histories available, so that
folks can, say, get at a certain day or month of data from a day of
interest in the past. Another application requires very-current data only,
and doesn't care about anything more than a coup,e of minutes old.

"Bag of Holding" was a d reference -- a magical bag whose inside is much
bigger than its outside. (Like a TARDIS.)

I should have written "rsync -av" in which files are never deleted from the
destination. Anything new in the source gets copied to the destination, but
he destination copy stays even if the source file disappears.

This data usually comes in on Linux systems, but I did copy a big chunk
over to a Mac to get to bDrive.

-Greg

Le lundi 5 octobre 2015, Richard DESHONG <rdesh...@berkeley.edu
<javascript:_e(%7B%7D,'cvml','rdesh...@berkeley.edu');>> a écrit :

> Sorry Greg, I guess I misunderstood your original post.  It sounded like
> you have a local library (was that the "Bag of Holding") that you wanted to
> put "into the cloud".  Once it is in the cloud (bDrive or Box, in this
> case), are you saying that you don't want to have the local library?
>
> I was confused because you mentioned "additive rsync" which implies staff
> are putting the files into a local library and then you want to have those
> uploaded to the cloud.  At least, that's the way I saw it.
>
> On Mon, Oct 5, 2015 at 5:02 PM, Greg Merritt <gmerr...@berkeley.edu>
> wrote:
>
>> Too much data to stick in a local gDrive folder, really...want to have no
>> local long-term archive on a random desktop, if you digmaybe for a
>> one-time initial backfill, but then would want to purge from
>> localhmmm.
>>
>> Thanks for the tip on the sync index size!
>>
>> -Greg
>>
>> On Mon, Oct 5, 2015 at 4:54 PM, Richard DESHONG <rdesh...@berkeley.edu>
>> wrote:
>>
>>> Hi Greg,
>>> It seems like Google Drive is exactly what you want.  Install it, move
>>> all your files into the folder, and GD will churn away in the background
>>> uploading all of the files.  Moving forward, just drop new files in, and GD
>>> will sync those.
>>>
>>> I have, in the past, seen forum issues with the sync index size - that
>>> is, when the file count gets too large, the sync process fails.  So you'd
>>> need to research that first.
>>>
>>> On Mon, Oct 5, 2015 at 4:43 PM, Greg Merritt <gmerr...@berkeley.edu>
>>> wrote:
>>>
>>>> Ooh, no! I'll check it out. This may indeed be helpful after we get the
>>>> historical backlog up there.
>>>>
>>>> Thanks!
>>>>
>>>> -Greg
>>>>
>>>> On Mon, Oct 5, 2015 at 4:40 PM, Michael Chung <mch...@haas.berkeley.edu
>>>> > wrote:
>>>>
>>>>> Hi Greg,
>>>>>
>>>>> Have you checked this out?
>>>>>
>>>>> http://www.duplicati.com/
>>>>>
>>>>> Full disclaimer, I haven't used it myself, but it appears you can run
>>>>> incremental transfers, which should at least give you "rsync"-like
>>>>> functionality after an initial Full backup.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> *Michael Chung*
>>>>> Systems Administrator
>>>>> Enterprise Computing & Service Management
>>>>> Haas School of Business, UC Berkeley
>>>>> Student Services Building, Room S300D
>>>>> Berkeley, CA 94720-1900
>>>>> Tele: 510-643-3887
>>>>>
>>>>> Typical Office Schedule
>>>>> Offsite: M-F
>>>>> At Haas: On-demand
>>>>>
>>>>> On Mon, Oct 5, 2015 at 4:23 PM, Greg Merritt <gmerr...@berkeley.edu>
>>>>> wrote:
>>>>>
>>>>>> Hello Micronet,
>>>>>>
>>>>>> We'd love to use our SPA bDrive as an archive location for a
>>>>>> infrequently and selectively accessed Bag of Holding for data sets of
>>>>>> millions of small, individual, already-compressed ~10

Re: [Micronet] Oracle Enterprise License Agreement

[Greg MERRITT]

Thanks for the follow-up, Walter.

Is there any alternate ways for us to combine Spatial with your team's
services and the campus license, for our database?  Or even invoke it in
some sort of unsupported mode?  It's pretty central to our use.

Thanks!

-Greg

On Thu, Feb 26, 2015 at 4:08 PM, Walter Stokes wal...@berkeley.edu wrote:

 Greg:



 Unfortunately, the Spatial and Graph options were not included in this
 agreement.



 Obviously the Oracle database has a number of separately licensed
 features, and we could only include certain ones. As you can see from the
 list below, under this agreement we’re constrained to : Partitioning,   
 Advanced
 Security,  Active Data Guard,   Diagnostics  Tuning Packs and  Data
 Masking Pack.



 I’m glad to hear that this helps, and please let us know if we can be of
 further assistance!



 Walter







 *From:* Greg MERRITT [mailto:gmerr...@berkeley.edu]
 *Sent:* Thursday, February 26, 2015 1:57 PM
 *To:* Walter Stokes
 *Cc:* micronet-list@lists.berkeley.edu
 *Subject:* Re: [Micronet] Oracle Enterprise License Agreement



 Hi Walter,



 This is super cool!  It's likely to be very, very helpful to our group.



 Walter, is licensing/support for Oracle Spatial and Graph included?



 -Greg





 On Wed, Feb 25, 2015 at 12:44 PM, Walter Stokes wal...@berkeley.edu
 wrote:

 Please post to MicroNet :







 DATE: February 24, 2015

 RE:  Oracle Enterprise License Agreement

 TO:  Deans  Directors, Micronet, ITLG members, ITC members

 FR:  Larry Conrad, Associate Vice Chancellor for IT and Chief
 Information Officer

 Dear Colleagues,



 I am pleased to announce that UC Berkeley has entered into a new
 enterprise site licensing agreement with the Oracle Corporation to allow
 all faculty, staff, and students to use the Oracle products listed below,
 at no additional cost.



 Products include:

 · Oracle Database Enterprise Edition

 oPartitioning

 oAdvanced Security

 oActive Data Guard

 oDiagnostics  Tuning Packs

 oData Masking Pack

 Note: All other Oracle products must be licensed separately and are not
 covered by this enterprise agreement.

 *Do you currently have an Oracle license or want one?*

 If you, or your unit or department, are a license holder for Oracle
 products, you may be able to terminate your current support agreement and
 register as a user of the new campus enterprise license. This will allow
 you to obtain an Oracle Customer Support Identifier (CSI) that entitles you
 to phone, email, and Web-based support, as well as patches and no-cost
 upgrade to future releases of the same product.



 To better understand if the new Oracle enterprise license is right for
 you, please contact the IST Database team manager, Walter Stokes
 dbtic...@berkeley.edu. He and his team will work with you to determine
 if the enterprise agreement is the best option for your needs.

 *Interested in database support services? *

 The IST database administration team offers complete packages of hardware,
 database software, database administration and system administration in
 support of your database needs.



 We have developed our database service packages to:

 · Reduce the burden of database administration work for
 developers;

 · Keep costs low for the campus by sharing resources; and

 · Provide a secure and supported environment, maintained by
 professional database administrators.



 Learn more http://ist.berkeley.edu/ds/db/oracle/standardextended

 The new Oracle enterprise license agreement is being provided to the
 campus community in collaboration with the Student Information Systems
 Replacement project http://sisproject.berkeley.edu/. The SIS project’s
 expanded Oracle usage has made a license for the entire campus the most
 cost-effective and beneficial solution. Together, the SIS project and IST
 are partnering to deliver valuable services and expand support for
 faculty, students, and staff.



 If you have any questions, please contact Walter Stokes
 dbtic...@berkeley.edu, the IST Database team manager.



 Regards,

 Larry Conrad, Associate Vice Chancellor for IT and Chief Information
 Officer





 Thanks!



 Walter Stokes
 Senior Manager, Data Services
 UC Berkeley - Information Services  Technology
 2195 Hearst Ave, Berkeley, CA 94720
 Desk: 510-664-4084   Cell:  408-355-4029





 -
 The following was automatically added to this message by the list server:

 To learn more about Micronet, including how to subscribe to or unsubscribe
 from its mailing list and how to find out about upcoming meetings, please
 visit the Micronet Web site:

 http://micronet.berkeley.edu

 Messages you send to this mailing list are public and world-viewable, and
 the list's archives can be browsed and searched on the Internet.  This
 means these messages can be viewed by (among others) your bosses,
 prospective employers

Re: [Micronet] Oracle Enterprise License Agreement

[Greg MERRITT]

Hi Walter,

This is super cool!  It's likely to be very, very helpful to our group.

Walter, is licensing/support for Oracle Spatial and Graph included?

-Greg


On Wed, Feb 25, 2015 at 12:44 PM, Walter Stokes wal...@berkeley.edu wrote:

 Please post to MicroNet :







 DATE: February 24, 2015

 RE:  Oracle Enterprise License Agreement

 TO:  Deans  Directors, Micronet, ITLG members, ITC members

 FR:  Larry Conrad, Associate Vice Chancellor for IT and Chief
 Information Officer

 Dear Colleagues,



 I am pleased to announce that UC Berkeley has entered into a new
 enterprise site licensing agreement with the Oracle Corporation to allow
 all faculty, staff, and students to use the Oracle products listed below,
 at no additional cost.



 Products include:

 · Oracle Database Enterprise Edition

 oPartitioning

 oAdvanced Security

 oActive Data Guard

 oDiagnostics  Tuning Packs

 oData Masking Pack

 Note: All other Oracle products must be licensed separately and are not
 covered by this enterprise agreement.

 *Do you currently have an Oracle license or want one?*

 If you, or your unit or department, are a license holder for Oracle
 products, you may be able to terminate your current support agreement and
 register as a user of the new campus enterprise license. This will allow
 you to obtain an Oracle Customer Support Identifier (CSI) that entitles you
 to phone, email, and Web-based support, as well as patches and no-cost
 upgrade to future releases of the same product.



 To better understand if the new Oracle enterprise license is right for
 you, please contact the IST Database team manager, Walter Stokes
 dbtic...@berkeley.edu. He and his team will work with you to determine
 if the enterprise agreement is the best option for your needs.

 *Interested in database support services? *

 The IST database administration team offers complete packages of hardware,
 database software, database administration and system administration in
 support of your database needs.



 We have developed our database service packages to:

 · Reduce the burden of database administration work for
 developers;

 · Keep costs low for the campus by sharing resources; and

 · Provide a secure and supported environment, maintained by
 professional database administrators.



 Learn more http://ist.berkeley.edu/ds/db/oracle/standardextended

 The new Oracle enterprise license agreement is being provided to the
 campus community in collaboration with the Student Information Systems
 Replacement project http://sisproject.berkeley.edu/. The SIS project’s
 expanded Oracle usage has made a license for the entire campus the most
 cost-effective and beneficial solution. Together, the SIS project and IST
 are partnering to deliver valuable services and expand support for
 faculty, students, and staff.



 If you have any questions, please contact Walter Stokes
 dbtic...@berkeley.edu, the IST Database team manager.



 Regards,

 Larry Conrad, Associate Vice Chancellor for IT and Chief Information
 Officer





 Thanks!



 Walter Stokes
 Senior Manager, Data Services
 UC Berkeley - Information Services  Technology
 2195 Hearst Ave, Berkeley, CA 94720
 Desk: 510-664-4084   Cell:  408-355-4029




 -
 The following was automatically added to this message by the list server:

 To learn more about Micronet, including how to subscribe to or unsubscribe
 from its mailing list and how to find out about upcoming meetings, please
 visit the Micronet Web site:

 http://micronet.berkeley.edu

 Messages you send to this mailing list are public and world-viewable, and
 the list's archives can be browsed and searched on the Internet.  This
 means these messages can be viewed by (among others) your bosses,
 prospective employers, and people who have known you in the past.


 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.

Re: [Micronet] [Announce] Microsoft Office for iOS now works with Box

[Greg MERRITT]

Er, I mean Office 365 subscription version.  Here's a quote from a review
after the you don't have to pay to edit! change:

It's important to note that, while these free apps aren't hamstrung in
significant ways, Office power users will find there are incentives for
purchasing an Office 365 subscription, including advanced change tracking
features, no limits on the ways you can use paragraph styles, and advanced
chart, table, and picture formatting tools.

So, yeah, they went from view-only or subscribe to edit to do lots of
editing, but not 100% of what the apps can do.

Hm, maybe I was just doing something wrong with the projector,
thoughI'll check again.  (If anyone has used the
non-office-365-subscription version of PowerPoint on iOS, and has tried
projecting, let me know how it went!)

Thanks,

-Greg



On Tue, Feb 17, 2015 at 10:24 AM, Ian Crew ic...@berkeley.edu wrote:

 As far as I'm aware, there's not a free vs. full version of iOS
 office...I've never tried projecting with it, though.

 Cheers,

 Ian

 On Feb 17, 2015, at 10:21 AM, Greg MERRITT gmerr...@berkeley.edu wrote:

 Cool!

 Ian, any word about if/whether/when we might be able to use the full
 version of iOS Office under campus agreement?  (I tried using iOS
 PowerPoint for a presentation, and I believe that it was refusing to use
 the external projector for the slideshow since it was running in freebie
 moded'oh!)

 -Greg


 On Tue, Feb 17, 2015 at 10:15 AM, Ian Crew ic...@berkeley.edu wrote:

 Hi All:

 FYI, last night, Microsoft released a new version of Office for iOS that
 adds Box storage capabilities (in addition to the existing Dropbox and
 OneDrive support).

 See
 http://blogs.office.com/2015/02/17/new-cloud-storage-integration-office/
 for Microsoft's announcement,
 http://blog.box.com/2015/02/a-more-open-enterprise/ for Box's
 announcement, and http://kb.berkeley.edu/page.php?id=44390 for our
 comparison of the various collaboration options that are supported here on
 campus, which includes a good overview of the capabilities of the Box
 service.

 Cheers,

 Ian


 ___
 Ian Crew

 IST-Architecture, Platforms and Integration (API)
 Earl Warren Hall, Second Floor
 University of California, Berkeley



 -
 The following was automatically added to this message by the list server:

 To learn more about Micronet, including how to subscribe to or
 unsubscribe from its mailing list and how to find out about upcoming
 meetings, please visit the Micronet Web site:

 http://micronet.berkeley.edu

 Messages you send to this mailing list are public and world-viewable, and
 the list's archives can be browsed and searched on the Internet.  This
 means these messages can be viewed by (among others) your bosses,
 prospective employers, and people who have known you in the past.



 ___
 Ian Crew

 IST-Architecture, Platforms and Integration (API)
 Earl Warren Hall, Second Floor
 University of California, Berkeley


 
-
The following was automatically added to this message by the list server:

To learn more about Micronet, including how to subscribe to or unsubscribe from 
its mailing list and how to find out about upcoming meetings, please visit the 
Micronet Web site:

http://micronet.berkeley.edu

Messages you send to this mailing list are public and world-viewable, and the 
list's archives can be browsed and searched on the Internet.  This means these 
messages can be viewed by (among others) your bosses, prospective employers, 
and people who have known you in the past.