Skip to main content



      Home
Home » Archived » Gyrex » workspace folder is huge
workspace folder is huge [message #1710663] Thu, 08 October 2015 05:16 Go to next message
Eclipse UserFriend
Hi All,

I have just run the server with production configuration for about half month, and today I found that the size of the workspace size was about 45G.

Specially for following two folders:

/data/mumunion_gyrex/workspace/zookeeper/version-2
This folder includes some snapshot files about jobs.

/data/mumunion_gyrex/workspace/zookeeper/logs/version-2
This folder includes logs for jobs.

Can I change the storage way for that snapshot files, such as mongo or mysql?

Or, Can I customize the storage path for the snapshot files?

Thanks
Sean
Re: workspace folder is huge [message #1710665 is a reply to message #1710663] Thu, 08 October 2015 05:23 Go to previous messageGo to next message
Eclipse UserFriend
Are u using the embedded zookeeper in production mode?
Re: workspace folder is huge [message #1710696 is a reply to message #1710663] Thu, 08 October 2015 09:14 Go to previous messageGo to next message
Eclipse UserFriend
Hi Sean,


On 2015-10-08 09:16:49 +0000, Sean Zhang said:
> /data/mumunion_gyrex/workspace/zookeeper/version-2
> /data/mumunion_gyrex/workspace/zookeeper/logs/version-2

That looks like the Zookeeper storage files. The embedded Zookeeper is
only started in development mode. However, the built-in cleanup only
happens during server start/stop.

Quick question, have you setup a separate Zookeeper cluster?
https://wiki.eclipse.org/Gyrex/Administrator_Guide#Preparing_for_Production_Deployment


Zookeeper needs some regular clean-up of its data directory. That
usually happens via a cron script after/as part of the backup story.
http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html#Ongoing+Data+Directory+Cleanup


-Gunnar


--
Gunnar Wagenknecht
gunnar@xxxxxxxx
Re: workspace folder is huge [message #1710753 is a reply to message #1710665] Thu, 08 October 2015 21:41 Go to previous messageGo to next message
Eclipse UserFriend
Yes
Jürgen Albert wrote on Thu, 08 October 2015 09:23
Are u using the embedded zookeeper in production mode?

Re: workspace folder is huge [message #1710755 is a reply to message #1710753] Thu, 08 October 2015 21:51 Go to previous messageGo to next message
Eclipse UserFriend
My business volume is still small, and currently it run on one cloud server, so I use the embedded zookeeper right now. I will follow the production deploy guide to setup a cloud to support the business if the it grows quickly.
Re: workspace folder is huge [message #1710763 is a reply to message #1710755] Fri, 09 October 2015 01:35 Go to previous message
Eclipse UserFriend
On 2015-10-09 01:51:58 +0000, Sean Zhang said:

> My business volume is still small, and currently it run on one cloud
> server, so I use the embedded zookeeper right now. I will follow the
> production deploy guide to setup a cloud to support the business if the
> it grows quickly.

That's fine. You can also run standalone if you like.

For now, please setup a cron job, that regulary purges old Zookeeper
transaction logs and snapshots.

Zookeeper needs some regular clean-up of its data directory. That
usually happens via a cron script after/as part of the backup story.
http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html#Ongoing+Data+Directory+Cleanup


-Gunnar

--
Gunnar Wagenknecht
gunnar@xxxxxxxx
Previous Topic:custom node tags
Next Topic:How to setup the configuration in program?
Goto Forum:
  


Current Time: Mon May 05 18:23:26 EDT 2025

Powered by FUDForum. Page generated in 0.03775 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top