Auto Delete MongoDB documents after 30d - node.js

I building a calendar app with React & Express.js & Mongo DB
the calendar has month view displays weekly events, and i want to delete these events automaticlly after 30 days
my schema.ts:
import { Calendar } from "../types";
const calendarSchema = new mongoose.Schema<Calendar>(
{
startDate: {
type: String,
required: true,
},
endDate: {
type: String,
required: true,
},
rRule: {
type: String,
},
title: {
type: String,
required: true,
},
notes: {
type: String,
// required: true,
},
type: {
type: String,
required: true,
},
expireAt: {
type: Number,
},
},
{
timestamps: true,
}
);
calendarSchema.index({ expireAt: 1 }, { expireAfterSeconds: 70 });
export default mongoose.model<Calendar>("Calendar", calendarSchema);
and i am creating a "expireAt" field in my front-end like:
const payload = await createAppointment({
...appointment,
expireAt: new Date().getTime() + 80,
});
now this deletes documents in 40 - 50 seconds, my question is how can i make it 30 or 31 days ?
thanks in advance .

Change expireAt to Date instead of number
And when creating an index assign 0 to expireAfterSeconds
calendarSchema.index({ expireAt: 1 }, { expireAfterSeconds: 0 });
Now you can define the exact date of when each Calendar will expire, from yearly or down back to seconds
For more info, check MongoDB's documentation

The issue is that you set expiry to be after 70 seconds:
calendarSchema.index({ expireAt: 1 }, { expireAfterSeconds: 70 });
Instead of 70 in the expireAfterSeconds just push the value you want, for example for 7 days:
60 * 60 * 24 * 7 = 604800

Related

MongoDB TTL index document not deleted on time

I am trying to delete a MongoDB document after 5 minutes but it deleted almost after 2 min. I exactly don't know the issue. Any help is highly appreciated.
const hospitalRecordSchema = new mongoose.Schema({
hospital_id: {
type: String,
},
hospital_name: {
type: String,
},
created_at: {
type: Date,
default: new Date(),
expires: "5m",
index: true,
},
data: {
type: Object,
default: {},
},
});
hospitalRecordSchema.index({ created_at: 1 }, { expireAfterSeconds: 300 });
module.exports = mongoose.model("HospitalRecord", hospitalRecordSchema);

is it possible to expire in 1 min in model of particular data like stored otp in mongodb

const mongoose = require("mongoose");
const expirationTime=10
let currentTime = Date.now();
const userSchema = new mongoose.Schema(
{
fullName: {
type: String,
required: false,
},
email: {
type: String,
required: false,
},
mobile_number: {
type: String,
required: false,
},
password: {
type: String,
required: false,
},
otp_instance: [{
otp_id: {
type: mongoose.Schema.Types.ObjectId,
required: false
},
otp: {
type: String,
// index: {expires:'1m'},
required: false
},
createdAt: {
type: Date,
default: Date()
},
expiration_time: {
type: Date,
default: new Date(currentTime+(expirationTime * 1000))
},
// otp: { type: String, index: { expires: 300 }}
}],
resetLink: {
type: String,
required: false,
},
isAccountVerified: {
type: String,
required: false,
},
token: {
type: String,
required: false,
},
activeStatus: {
type: String,
required: false,
default: "0",
},
deletedStatus: {
type: String,
required: false,
default: "0",
},
},
{ timestamps: true }
);
// userSchema.createIndex( { otp: 1 }, { expireAfterSeconds: 36000 } )
const userModel = mongoose.model("user", userSchema);
module.exports = userModel;
is it possible to expire in 1 min in model of particular data like stored otp in mongodb
is it possible to expire in 1 min in model of particular data like stored otp in mongodb
is it possible to expire in 1 min in model of particular data like stored otp in mongodb> is it possible to expire in 1 min in model of particular data like stored otp in mongodb> is it possible to expire in 1 min in model of particular data like stored otp in mongodb> is it possible to expire in 1 min in model of particular data like stored otp in mongodb> is it possible to expire in 1 min in model of particular data like stored otp in mongodb

Mongoose - How to change the TTL based on another field?

How would I set the TTL based on another field in the schema? I want to set the the expireAt field to whatever value accountType is (the value can be a month / a week / a day).However, this code doesn't expire the document or change the expiry date. I've tried many variations of the TTL field but it doesn't seem to work.
import mongoose from 'mongoose'
import { generateKey } from '../lib/generateKey'
const KeySchema = new mongoose.Schema({
key: {
type: String,
default: generateKey,
required: true,
},
accountType: { /* The value can be a month, a week or a day*/
type: String,
required: true,
},
dailyLimit: {
type: Number,
default: 0,
required: true,
},
expireAt: {
type: Date,
default: Date.now,
index: {
expireAfterSeconds: 60
}
},
})
KeySchema.pre('save', function (next) {
switch (this.accountType) {
case 'month':
this.expireAt.index = {
expires: 60 * 60 * 24 * 30
}
break
case 'week':
this.expireAt.index = {
expires: 60 * 60 * 24 * 7
}
break
case 'day':
this.expireAt.index = {
expires: 60 * 60 * 24 * 1
}
break
}
next()
})
export default mongoose.models.Key || mongoose.model('Key', KeySchema)
I've tried
createdAt: { type: Date, expires: 600 },
KeySchema.index({ createdAt: 1 }, { expireAfterSeconds: 3600 })
expireAt: { type: Date, default: Date.now, index: { expires: '5s' }}
MongoDB handles TTL using an index
Mongoose creates the TTL index at the same time it create all of the other indexes, based on the schema, and the same index is used for all documents.
While it is possible to have partial indexes based on field values, MongoDB does not permit creating multiple indexes that contain the same keys but different options, like expiry.
Instead of trying to vary the index option expireAfterSeconds for each document, you might add another field to the scheme named deleteAt with expireAfterSeconds set to 0, then in the pre-save function set deletedAt based on the values of the expireAt and accountType fields.

NodeJS / Express : Add default subscription period to user account

I'm building an application with express framework and I want to set a default subscription period to user when get registered ( 6 months by default for example ), after that period, user must pay a specific amount to get access to the app, can some one explain or help by technicals ideas ?
const mongoose = require('mongoose');
const schema = new mongoose.Schema({
email: {
type: String,
unique: true,
required: true
},
passwordHash: {
type: String,
required: true
},
title: {
type: String,
required: true
},
firstName: {
type: String,
required: true
},
lastName: {
type: String,
required: true
},
phone: {
type: String,
required: true
},
acceptTerms: Boolean,
subscriptionPeriod:{
type: Number,
default: 6
},
payed:{
type:Boolean,
default: true
},
role: {
type: String,
required: true
},
verificationToken: String,
verified: Date,
resetToken: {
token: String,
expires: Date
},
passwordReset: Date,
created: {
type: Date,
default: Date.now
},
updated: Date
});
schema.virtual('isVerified').get(function() {
return !!(this.verified || this.passwordReset);
});
module.exports = mongoose.model('User', schema);
You can use scheduler in node js which will invoke like whatever duration you want to set. There is a package node-cron node-cron package.
With this you can scheduler every day and write logic to check which user plan has expired, based on that you can trigger email or disable the account.
var cron = require('node-cron');
var job = cron.schedule('0 0 0 * * *', function() {
//will run every day at 12:00 AM
//set logic here to check if expiry date is 6 month
})
AWS lambda can also be used if working with aws. For more information visit this link
Scheduling with aws lambda

Mongoose - Set TTL on MongoDB Document

I am trying to set a TTL via mongoose when a document is created in MongoDB, but I'm not having any luck with any of my attempts. Latest version of mongoose is being used in my project and from what I can tell I've tried the most common answers here on SO and elsewhere online.
My Schema
const mongoose = require('mongoose');
const jobSchema = new mongoose.Schema(
{
positionTitle: {
type: String,
},
description: {
type: String,
}
});
const Jobs = mongoose.model('job', jobSchema);
module.exports = Jobs;
I have tried adding a createdAt with expires based on this question answer:
const jobSchema = new mongoose.Schema({
positionTitle: {
type: String,
},
description: {
type: String,
},
createdAt: { type: Date, expires: 3600 },
});
Along with this option that's also in the same question to have createdAt be created automatically via timestamps:
const jobSchema = new mongoose.Schema(
{
positionTitle: {
type: String,
},
description: {
type: String,
},
},
{ timestamps: true }
);
Trying variations of the following to set an index with timestamps defined:
jobSchema.index({ createdAt: 1 }, { expires: 86400 });
jobSchema.index({ createdAt: 1 }, { expires: '1 day' });
jobSchema.index({ createdAt: 1 }, { expireAfterSeconds: 3600 });
Regardless of which option I try, the document is removed after MongoDB's 60-second cycle when a createdAt field is set on the document. Would really love to know what I'm doing wrong.
After trying all the solutions in the thread you mentioned, none of them worked. In the end this code did the trick. It involves setting the expireAt field to the actual time that you want it deleted, which makes sense really.
const Schema = mongoose.Schema;
const YourSchema = new Schema({
expireAt: {
type: Date,
default: Date.now() + 10 * 60 * 1000 // expires in 10 minutes
},
});
This is the only thing that worked, all the other solutions I tried always deleted after 1min, no matter the amount of time I added.
I've been having issues with this as well. I found this thread here https://github.com/Automattic/mongoose/issues/2459 and it worked for me. Translated into your code would look like this.
const mongoose = require('mongoose');
const jobSchema = new mongoose.Schema(
{
positionTitle: {
type: String,
},
description: {
type: String,
},
expireAt: {
type: Date,
default: Date.now,
index: { expires: '5s' }
}
});
const Jobs = mongoose.model('job', jobSchema);
module.exports = Jobs;
On the link I added, it is the very last solution. I'm not exactly sure what this is doing but here is the mongo link of what it should be doing for anyone else with this issue. https://docs.mongodb.com/manual/tutorial/expire-data/. To change the amount of time that you need the document just change the expires. It accepts '#s' and '#d' for sure. Also if you want your document to be deleted at a specific time then you can do this.
expireAt: {
type: Date,
default: new Date('July 22, 2013 14:00:00'),
index: { expires: '0s' }
}
This will delete the document 0 seconds after the specified date.
Problem in TTL, Reason behind Document does not delete after some / few seconds, how to expire document in MongoDB / Mongoose using schema. Solution expireAfterSeconds / expires / index.
NOTE: - MongoDB's data expiration task runs once a minute, so an expired doc might persist up to a minute past its expiration. This feature requires MongoDB 2.2 or later. It's up to you to set createdAt to the current time when creating docs or add a default to do it for you as suggested here.
NOTE :- Below code is working fine and the document will delete after 5 minutes.
const verficationSchema = new mongoose.Schema({
email: {
type: String,
required: true,
unique: true,
lowercase: true,
trim: true,
validate(email) {
if (!validator.isEmail(email)) {
throw new Error("Email is not valid!");
}
},
},
otp: {
type: Number,
required : true
},
expireAt : {
type: Date,
default: Date,
expires : 300 // means 300 seconds = 5 minutes
}
});
NOTE :- Upper code is working fine, But document will delete after 1 minutes, because MongoDB check expiration procedure after every 1 minutes.
const verficationSchema = new mongoose.Schema({
email: {
type: String,
required: true,
unique: true,
lowercase: true,
trim: true,
validate(email) {
if (!validator.isEmail(email)) {
throw new Error("Email is not valid!");
}
},
},
otp: {
type: Number,
required : true
},
expireAt : {
type: Date,
default: Date,
expires : 8 // means 8 seconds
}
});

Resources