EC2 AMI version

This forum is for issues related to parallel processing
and OpenSees using the new interpreters OpenSeesSP and OpenSeesMP

Moderator: selimgunay

beng
Posts: 2
Joined: Sat Mar 19, 2016 6:08 am

EC2 AMI version

Post by beng » Sat Mar 19, 2016 6:11 am

Hi,

Using the Amazon EC2 AMI I'm getting the following error, that I'm not getting when i run on windows...

Want: uniaxialMaterial Hysteretic tag? mom1p? rot1p? mom2p? rot2p? <mom3p? rot3p?> mom1n? rot1n? mom2n? rot2n? <mom3n? rot3n?> pinchX? pinchY? damfc1? damfc2? <beta?>

I see from other posts that new versions fix this issue, but the EC2 AMI seems to be on 2.4.6 (6022) - is there an updated version? or how could i update the AMI myself?

Many Thanks in advance!

Ben

fmk
Site Admin
Posts: 5883
Joined: Fri Jun 11, 2004 2:33 pm
Location: UC Berkeley
Contact:

Re: EC2 AMI version

Post by fmk » Mon Mar 21, 2016 10:12 am

i am in the process of making one for the new release .. you can of course make your own by starting with some blank linux ami, installing and building OpenSees and then creating an image of what you have.

beng
Posts: 2
Joined: Sat Mar 19, 2016 6:08 am

Re: EC2 AMI version

Post by beng » Mon Mar 21, 2016 1:47 pm

Ok thanks very much for the speedy reply, I'll wait for your new release. No doubt it will be better as i am by no means an expert.

Ben

fmk
Site Admin
Posts: 5883
Joined: Fri Jun 11, 2004 2:33 pm
Location: UC Berkeley
Contact:

Re: EC2 AMI version

Post by fmk » Wed May 04, 2016 12:25 pm

you are running the command from a dos prompt and starcluster is on your PATH

fmk
Site Admin
Posts: 5883
Joined: Fri Jun 11, 2004 2:33 pm
Location: UC Berkeley
Contact:

Re: EC2 AMI version

Post by fmk » Wed May 11, 2016 4:26 pm

thanks .. i might need to upgrade to windows10 as i hate dos

fmk
Site Admin
Posts: 5883
Joined: Fri Jun 11, 2004 2:33 pm
Location: UC Berkeley
Contact:

Re: EC2 AMI version

Post by fmk » Thu May 26, 2016 7:55 am

thanks for the info .. i have updated the opensees amazon page ..

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Mon Aug 22, 2016 9:34 pm

dear @Cagatay

Setuptool seems not work after clickiing on ez_setup.py and poping up a black window of python in firefox.
downloading setuptools-26.0.0.zip...

Command prompt cannot recogize the command of pip install StarCluster.
Could you give me some advice?
Thanks a lot!
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Mon Aug 22, 2016 9:55 pm

C:\Users\Administrator.USER-20160705YO>starcluster start smallcluster

Traceback (most recent call last):
File "D:\Python27\Scripts\starcluster-script.py", line 5, in <module>
from pkg_resources import load_entry_point
File "D:\Python27\lib\site-packages\pkg_resources.py", line 2603, in <mod
working_set.require(__requires__)
File "D:\Python27\lib\site-packages\pkg_resources.py", line 666, in requi
needed = self.resolve(parse_requirements(requirements))
File "D:\Python27\lib\site-packages\pkg_resources.py", line 565, in resol
raise DistributionNotFound(req) # XXX put more info here
pkg_resources.DistributionNotFound: optcomplete>=1.2-devel

C:\Users\Administrator.USER-20160705YO>
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Tue Aug 23, 2016 6:51 am

Dear @cgtydmrc

Thanks for your sharing your resource for instruction.
I install them again in window 7 system.

I type "C:\Python27\Scripts>pip install StarCluster" in dos prompt.
Error message shows that C:\Python27\Scripts\pip.exe is not compatible with the version of windows system.

And I find the problem may be located in setuptool that value error: Entry point must be listed in groupstayou could take a look in google drive linked below.
https://drive.google.com/file/d/0B2M0Ty ... sp=sharing

cgtydmrc wrote:
> Dear Kai,
>
> When you would like to install setuptools, please use mozilla firefox. When
> you click on ez_setup.py, it will directly be installed.
>
> You will install StarCluster by running CMD in this directory
> C:\Python27\Scripts.
>
> You can find detailed information here..
> https://drive.google.com/drive/folders/ ... mNvekVENHc
Last edited by kengawk on Tue Aug 23, 2016 7:07 am, edited 1 time in total.
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Tue Aug 23, 2016 7:12 am

Thanks for your help!
Try it as your suggestion goes.

And now I think I found the problem is that the setuptool can not be installed successfullly.
The following is error when I am installing setuptool.
value error comes up.It warns that Entry points must be listed in groups.

https://drive.google.com/file/d/0B2M0Ty ... sp=sharing
Extracting in c:\users\admini~1.use\appdata\local\temp\tmpteovsq
Now working in c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.
0.0
Installing Setuptools
Traceback (most recent call last):
File "setup.py", line 194, in <module>
dist = setuptools.setup(**setup_params)
File "C:\Python27\lib\distutils\core.py", line 111, in setup
_setup_distribution = dist = klass(attrs)
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\set
uptools\dist.py", line 349, in __init__
for ep in pkg_resources.iter_entry_points('distutils.setup_keywords'):
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 730, in iter_entry_points
entries = dist.get_entry_map(group)
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 2629, in get_entry_map
self._get_metadata('entry_points.txt'), self
File "c:\users\admini~1.use\appdata\local\temp\tmpteovsq\setuptools-26.0.0\pkg
_resources\__init__.py", line 2363, in parse_map
raise ValueError("Entry points must be listed in groups")
ValueError: Entry points must be listed in groups
Something went wrong during the installation.
See the error message above.


And I installed VS2012.

Thanks again! I really appreciate it.

cgtydmrc wrote:
> You shoud open command prompt in this directory
> "C:\Python27\Scripts" by shift button and right click. Then you
> should type "pip install StarCluster".
>
>
> ***You may also need to install Visual Studio if you confront any problems
> when installing StarCluster.*** This is very important.
>
> Hope this helps.
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Wed Aug 24, 2016 6:16 pm

Dear Cagatay,

Now I found that it's proper for me to make 32bit python installation so that I could install starcluster successfully

according to the instruction that you shared with me.

What is the most important info in the config file? I really feel a little bit confused.
Now I changed the segments in config file as below:
1AWS_ACCESS_KEY_ID = #your_aws_access_key_id
2AWS_SECRET_ACCESS_KEY = #your_secret_access_key
3AWS_USER_ID= #your userid
4[key mykey]
5KEY_LOCATION=~/.ssh/mykey.rsa
6KEYNAME = mykey

How can I revise the keypair? I creat key according to the contents from 'starcluster createkey -help'

G:\peer\AmazonEC2>starcluster createkey -i pk-APKAICAVVT6INVOFHD4Q.pem -o myfirs
t.rsa myfirst
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Successfully created keypair: myfirst
>>> fingerprint: 98:3a:ea:f0:60:65:80:be:aa:1b:61:32:52:1f:a0:85


and it seems to create a rsa file from keypair file with a keyname,but where's the rsa file? I can't find it in my computer.
How can I revise the config file and create key file correctly?

G:\peer\AmazonEC2>starcluster start smallcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
!!! ERROR - Cluster settings are not valid:
!!! ERROR - key_location
!!! ERROR - 'C:\Users\Administrator.USER-20160705YO/.ssh/myfirst.rsa'
!!! ERROR - does not exist

Cheers,

Kai

@cgtydmrc
cgtydmrc wrote:
> You shoud open command prompt in this directory
> "C:\Python27\Scripts" by shift button and right click. Then you
> should type "pip install StarCluster".
>
>
> ***You may also need to install Visual Studio if you confront any problems
> when installing StarCluster.*** This is very important.
>
> Hope this helps.
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

kengawk
Posts: 103
Joined: Wed Oct 31, 2007 11:55 pm
Location: Beijing JIaotong University
Contact:

Re: EC2 AMI version

Post by kengawk » Fri Aug 26, 2016 7:27 am

Thank you,Cagatay!!
It is really a great help for me!

Now I met a problem once more according to that demo video, could you give me some tips?

I cannot start the cluster,the error messages is as the following.
C:\Users\Administrator.USER-20160705YO>starcluster start myfirstcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

Thanks again.
I solved that problem.
1 starcluster createkey mykey -o ~/.ssh/mykey.rsa
2Revised the keypair name mykey to agree with the name from starcluster!
[key mykey]
KEY_LOCATION=C:/Users/Administrator.USER-20160705YO/.ssh/mykey.rsa
[cluster smallcluster]
# change this to the name of one of the keypair sections defined above
KEYNAME = mykey



C:\Users\Administrator.USER-20160705YO>starcluster start myfirstcluster
StarCluster - (http://star.mit.edu/cluster) (v. 0.95.6)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster@mit.edu

>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
>>> Cluster template settings are valid
>>> Starting cluster...
>>> Launching a 2-node cluster...
>>> Creating security group @sc-myfirstcluster...
Reservation:r-0b21043af727c806b
>>> Waiting for instances to propagate...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for cluster to come up... (updating every 30s)
>>> Waiting for all nodes to be in a 'running' state...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for SSH to come up on all nodes...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Waiting for cluster to come up took 2.542 mins
>>> The master node is ec2-54-163-55-141.compute-1.amazonaws.com
>>> Configuring cluster...
>>> Running plugin starcluster.clustersetup.DefaultClusterSetup
>>> Configuring hostnames...
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Creating cluster user: sgeadmin (uid: 1001, gid: 1001)
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Configuring scratch space for user(s): sgeadmin
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Configuring /etc/hosts on each node
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Starting NFS server on master
>>> Configuring NFS exports path(s):
/home
>>> Mounting all NFS export path(s) on 1 worker node(s)
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Setting up NFS took 0.439 mins
>>> Configuring passwordless ssh for root
>>> Configuring passwordless ssh for sgeadmin
>>> Running plugin starcluster.plugins.sge.SGEPlugin
>>> Configuring SGE...
>>> Configuring NFS exports path(s):
/opt/sge6
>>> Mounting all NFS export path(s) on 1 worker node(s)
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Setting up NFS took 0.271 mins
>>> Installing Sun Grid Engine...
1/1 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Creating SGE parallel environment 'orte'
2/2 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%
>>> Adding parallel environment 'orte' to queue 'all.q'
>>> Configuring cluster took 3.287 mins
>>> Starting cluster took 5.919 mins

The cluster is now ready to use. To login to the master node
as root, run:

$ starcluster sshmaster myfirstcluster

If you're having issues with the cluster you can reboot the
instances and completely reconfigure the cluster from
scratch using:

$ starcluster restart myfirstcluster

When you're finished using the cluster and wish to terminate
it and stop paying for service:

$ starcluster terminate myfirstcluster

Alternatively, if the cluster uses EBS instances, you can
use the 'stop' command to shutdown all nodes and put them
into a 'stopped' state preserving the EBS volumes backing
the nodes:

$ starcluster stop myfirstcluster

WARNING: Any data stored in ephemeral storage (usually /mnt)
will be lost!

You can activate a 'stopped' cluster by passing the -x
option to the 'start' command:

$ starcluster start -x myfirstcluster

This will start all 'stopped' nodes and reconfigure the
cluster.







>>> Using default cluster template: smallcluster
>>> Validating cluster template settings...
!!! ERROR - Cluster settings are not valid:
!!! ERROR - Keypair 'mykeypairname' doe-------------s not exist in region 'us-east-1'

@cgtydmrc wrote:
> You can also watch the video in the following link which helps you how to
> modify your own config file. http://star.mit.edu/cluster/index.html
Kai Zhang
------------------------------
PH.D. candidate
School of Civil Engineering&Architecture
Beijing Jiaotong University

egzonk
Posts: 1
Joined: Fri Oct 21, 2016 3:05 pm
Contact:

Re: EC2 AMI version

Post by egzonk » Fri Oct 21, 2016 3:09 pm

cgtydmrc wrote:
> You can also watch the video in the following link which helps you how to
> modify your own config file. http://star.mit.edu/cluster/index.html

Thank you very mutch sir , it rreally helped me. 8)
Free VPS 1
----------------]
Free VPS 2

vickytaneja
Posts: 1
Joined: Fri Mar 22, 2019 5:22 am

Re: EC2 AMI version

Post by vickytaneja » Fri Mar 22, 2019 5:26 am

Your Content is as decent as you seem to be.

A debt of gratitude is in order for sharing such profitable data.

Kindly see this - https://malwarebrains.blogspot.com/2019 ... ivers.html

jk7070
Posts: 2
Joined: Wed May 11, 2011 11:55 am
Location: Netherlands

Re: EC2 AMI version

Post by jk7070 » Wed Jun 05, 2019 5:20 am

Hi,

Can the AmazonEC2 cluster be used with opensees files written in python (.py) rather the .tcl? I have models built using opensees.py and it would be nice if we could run these without having to rewrite in .tcl.

If it is currently not supported, is it likely it will be supported in the future and if so how far away is this likely to be?

Regards

Post Reply