Skip to main content


Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Archived » Gyrex » workspace folder is huge
workspace folder is huge [message #1710663] Thu, 08 October 2015 09:16 Go to next message
Sean Zhang is currently offline Sean ZhangFriend
Messages: 20
Registered: July 2015
Location: China
Junior Member

Hi All,

I have just run the server with production configuration for about half month, and today I found that the size of the workspace size was about 45G.

Specially for following two folders:

/data/mumunion_gyrex/workspace/zookeeper/version-2
This folder includes some snapshot files about jobs.

/data/mumunion_gyrex/workspace/zookeeper/logs/version-2
This folder includes logs for jobs.

Can I change the storage way for that snapshot files, such as mongo or mysql?

Or, Can I customize the storage path for the snapshot files?

Thanks
Sean


Study every day, and love every day!
Re: workspace folder is huge [message #1710665 is a reply to message #1710663] Thu, 08 October 2015 09:23 Go to previous messageGo to next message
Jürgen Albert is currently offline Jürgen AlbertFriend
Messages: 2
Registered: July 2013
Junior Member
Are u using the embedded zookeeper in production mode?
Re: workspace folder is huge [message #1710696 is a reply to message #1710663] Thu, 08 October 2015 13:14 Go to previous messageGo to next message
Gunnar Wagenknecht is currently offline Gunnar WagenknechtFriend
Messages: 486
Registered: July 2009
Location: San Francisco ✈ Germany
Senior Member

Hi Sean,


On 2015-10-08 09:16:49 +0000, Sean Zhang said:
> /data/mumunion_gyrex/workspace/zookeeper/version-2
> /data/mumunion_gyrex/workspace/zookeeper/logs/version-2

That looks like the Zookeeper storage files. The embedded Zookeeper is
only started in development mode. However, the built-in cleanup only
happens during server start/stop.

Quick question, have you setup a separate Zookeeper cluster?
https://wiki.eclipse.org/Gyrex/Administrator_Guide#Preparing_for_Production_Deployment


Zookeeper needs some regular clean-up of its data directory. That
usually happens via a cron script after/as part of the backup story.
http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html#Ongoing+Data+Directory+Cleanup


-Gunnar


--
Gunnar Wagenknecht
gunnar@xxxxxxxx
Re: workspace folder is huge [message #1710753 is a reply to message #1710665] Fri, 09 October 2015 01:41 Go to previous messageGo to next message
Sean Zhang is currently offline Sean ZhangFriend
Messages: 20
Registered: July 2015
Location: China
Junior Member

Yes
Jürgen Albert wrote on Thu, 08 October 2015 09:23
Are u using the embedded zookeeper in production mode?



Study every day, and love every day!
Re: workspace folder is huge [message #1710755 is a reply to message #1710753] Fri, 09 October 2015 01:51 Go to previous messageGo to next message
Sean Zhang is currently offline Sean ZhangFriend
Messages: 20
Registered: July 2015
Location: China
Junior Member

My business volume is still small, and currently it run on one cloud server, so I use the embedded zookeeper right now. I will follow the production deploy guide to setup a cloud to support the business if the it grows quickly.

Study every day, and love every day!
Re: workspace folder is huge [message #1710763 is a reply to message #1710755] Fri, 09 October 2015 05:35 Go to previous message
Gunnar Wagenknecht is currently offline Gunnar WagenknechtFriend
Messages: 486
Registered: July 2009
Location: San Francisco ✈ Germany
Senior Member

On 2015-10-09 01:51:58 +0000, Sean Zhang said:

> My business volume is still small, and currently it run on one cloud
> server, so I use the embedded zookeeper right now. I will follow the
> production deploy guide to setup a cloud to support the business if the
> it grows quickly.

That's fine. You can also run standalone if you like.

For now, please setup a cron job, that regulary purges old Zookeeper
transaction logs and snapshots.

Zookeeper needs some regular clean-up of its data directory. That
usually happens via a cron script after/as part of the backup story.
http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html#Ongoing+Data+Directory+Cleanup


-Gunnar

--
Gunnar Wagenknecht
gunnar@xxxxxxxx
Previous Topic:custom node tags
Next Topic:How to setup the configuration in program?
Goto Forum:
  


Current Time: Tue Apr 23 12:36:52 GMT 2024

Powered by FUDForum. Page generated in 0.02971 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top